-- Logs begin at Tue 2022-08-30 03:38:01 UTC, end at Tue 2022-08-30 04:48:12 UTC. -- Aug 30 04:17:28.708458 dv-cinder-854265-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:17:28.717976 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:17:28 2022] *** Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: nodename: dv-cinder-854265-2-iscsi Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: machine: x86_64 Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: clock source: unix Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: pcre jit disabled Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: detected number of CPU cores: 4 Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: current working directory: / Aug 30 04:17:28.719996 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: your processes number limit is 47680 Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: your memory page size is 4096 bytes Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: detected max file descriptor number: 2048 Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: lock engine: pthread robust mutexes Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: thunder lock: enabled Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:17:28.720674 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:17:28.759140 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: Python main interpreter initialized at 0x55e03aade9c0 Aug 30 04:17:28.759140 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: python threads support enabled Aug 30 04:17:28.759140 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: your server socket listen backlog is limited to 100 connections Aug 30 04:17:28.759140 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:17:28.759566 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:17:28.759566 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: *** Operational MODE: preforking *** Aug 30 04:17:28.759806 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:17:28.759806 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: spawned uWSGI master process (pid: 105474) Aug 30 04:17:28.760003 dv-cinder-854265-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:17:28.765069 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: spawned uWSGI worker 1 (pid: 105475, cores: 1) Aug 30 04:17:28.765069 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: spawned uWSGI worker 2 (pid: 105476, cores: 1) Aug 30 04:17:28.765069 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:17:29.417705 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:17:29.418305 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:17:30.503044 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:17:30.503044 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: from cryptography.utils import int_from_bytes Aug 30 04:17:30.503637 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:17:30.503637 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: from cryptography.utils import int_from_bytes Aug 30 04:17:30.508074 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:17:30.508074 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: from cryptography.utils import int_from_bytes Aug 30 04:17:30.508500 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:17:30.508500 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: from cryptography.utils import int_from_bytes Aug 30 04:17:32.973296 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:17:32.973856 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:17:32.974053 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:17:32.974412 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:17:32.974665 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:17:32.974847 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:17:32.975203 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.975285 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:17:32.975373 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.975624 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:17:32.975720 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.975963 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.976056 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:17:32.976239 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:17:32.976330 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.976583 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.976667 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.976898 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.976990 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.977295 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.977383 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.977617 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.977702 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.977906 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.977999 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.978224 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.978329 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.978543 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-iscsi {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.978637 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.978861 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.978955 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.979191 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.979274 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.979541 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.979850 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.979850 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980110 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980236 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980372 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-iscsi {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980497 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980620 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980761 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.980893 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.981103 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.981775 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.981938 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983044 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983207 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983337 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983462 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983587 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983709 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983845 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.983970 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984115 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984236 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984359 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984490 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984622 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984746 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984875 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.984998 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985147 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985270 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985530 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985660 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-iscsi {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985801 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.985926 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986048 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986169 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986290 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986402 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986540 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986656 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986778 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-iscsi {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.986900 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.987091 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.987227 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.987408 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.987546 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.987724 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.987853 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.988090 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.988238 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.988439 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.988578 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.988714 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.988841 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989021 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989188 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989358 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989495 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989694 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989838 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.989962 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.990085 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.990255 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.990392 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.990571 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.990722 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.990876 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991010 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991183 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991332 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991458 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991590 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991720 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.991844 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992028 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992165 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992344 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992478 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992663 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992807 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.992946 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993106 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993245 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993379 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993509 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993634 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993770 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.993927 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.994055 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.994252 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.994390 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.994526 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.994651 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.994773 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995028 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995232 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995435 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995583 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995710 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995842 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.995967 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.996092 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.996224 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.996356 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.996509 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.996638 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.996872 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.997555 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.997714 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.997844 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998021 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998156 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998341 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998554 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998692 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998816 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.998964 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.999099 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.999268 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.999395 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.999581 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.999708 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:32.999904 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000043 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000208 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000344 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000526 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000654 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000842 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.000976 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.001175 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.001322 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.001482 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.001624 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.001787 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.001916 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.002105 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.002502 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.002697 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.002833 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003001 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003134 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003269 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003403 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003534 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003658 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003828 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.003956 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.004158 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.004293 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.004422 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.004554 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.004728 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.004861 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005032 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005235 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005359 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005491 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005644 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005772 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.005985 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.006111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.006294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.006421 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.006603 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.006731 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.006909 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007036 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007217 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007344 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007524 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007658 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007832 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.007997 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.008123 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.008255 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.008432 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.008581 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.008781 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.008916 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009076 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009215 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009339 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009475 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009647 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009782 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.009950 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010076 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010257 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010393 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010570 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010697 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010881 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.010993 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.011190 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.011327 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.011499 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.011635 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.011820 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.011947 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.012128 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.012265 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.012454 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.012580 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.012762 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.012892 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.013099 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.013248 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.013401 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.013533 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.013705 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.013833 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014019 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014160 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014322 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014449 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014627 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014746 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.014928 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015066 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015231 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015660 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015835 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.015970 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.016135 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.016270 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.016436 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.016563 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.016732 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.016860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017062 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017203 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017365 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017493 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017672 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017800 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.017975 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.018104 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.018276 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.018395 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.018591 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.018718 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.018917 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.019043 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.019214 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.019351 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.019523 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.019656 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.019835 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.020007 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.020160 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:17:33.020298 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.020502 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.020629 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.020817 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.020944 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.021156 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.021304 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.021470 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.021600 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.021794 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.021922 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.022106 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.022234 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.022416 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.022543 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.022727 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.022856 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.023042 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.023171 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.023356 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.023485 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.023683 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.023817 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.024001 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.024130 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.024315 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.024459 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.024921 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025084 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025292 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025419 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025550 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025675 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025868 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.025997 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.026221 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.026346 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.028163 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.028400 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.028559 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.028692 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.028831 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029231 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029376 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029510 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029636 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029769 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.029901 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030085 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030214 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030338 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030460 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030584 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030708 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030831 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.030954 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031077 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031209 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031333 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031462 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031587 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031710 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031833 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.031970 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032094 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032228 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032353 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032476 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032599 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032731 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032731 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.032980 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033151 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033278 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033414 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033540 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033663 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033786 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.033918 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034049 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034181 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034306 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034429 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034552 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034685 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034809 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.034942 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035067 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035197 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035321 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035444 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035574 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035708 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035839 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.035964 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036094 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036219 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036351 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036476 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036600 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036722 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036845 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.036969 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037135 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037262 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037399 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037524 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037647 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037771 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.037904 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038030 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038154 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038276 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038403 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038526 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038662 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038794 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.038919 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039064 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039254 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039382 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039516 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039640 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039806 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.039935 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.040127 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.040272 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.040443 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.040558 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.040758 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.040854 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.041081 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.041191 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.041401 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.041495 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.041718 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.041815 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042023 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042114 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042336 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042421 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042646 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042729 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.042954 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.043049 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.043262 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.043352 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.043574 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.044161 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.044403 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.044506 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.044710 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.044802 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045022 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045194 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045359 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045496 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045676 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045805 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.045979 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.046105 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.046303 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.046433 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.046619 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.046753 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.046930 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047066 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047234 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047368 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047544 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047679 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047847 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.047984 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.048148 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.048276 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.048451 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.048587 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.048761 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.048898 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049079 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049238 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049428 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049558 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049681 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049818 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.049950 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.050075 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.050258 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.050403 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.050595 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.050734 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.050889 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051016 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051197 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051325 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051499 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051634 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051802 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.051929 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.052106 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.052238 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.052434 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.052563 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.052749 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.052877 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.053084 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.053187 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.053394 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.053489 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.053702 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.053802 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054024 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054123 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054341 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054450 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054652 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054744 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.054960 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055061 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055269 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055362 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055577 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055678 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055894 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.055996 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.056203 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.056303 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.056518 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.056610 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.056828 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.056929 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.057174 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.057266 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.057490 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.057578 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.057818 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.057951 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.058129 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.058214 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.058450 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.058531 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.058765 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.058848 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.059092 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.059177 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.059959 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.060054 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.060340 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.060464 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.060604 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.060707 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.060924 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.061010 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.061295 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.061383 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.061604 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.061687 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.061913 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062004 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062223 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062308 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062540 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062630 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062850 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.062942 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.063168 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.063260 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.063478 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.063564 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.063790 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.063882 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.064096 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.064179 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.064412 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.064495 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.064716 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.064819 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.065028 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.065139 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.065366 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.065449 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.065694 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.065787 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.066003 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.066085 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.066312 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.066395 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.066625 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.066888 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067037 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067185 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067325 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067472 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067619 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067757 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.067907 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068045 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068203 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068366 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068516 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068655 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068798 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.068936 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069108 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069255 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069401 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069540 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069688 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069833 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.069981 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.070207 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.070405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.070550 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.070687 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.070848 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.070990 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.071141 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.071289 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.071435 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.071582 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.071720 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.071856 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072011 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072149 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072285 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072421 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072565 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072704 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072850 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.072996 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.073177 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.073315 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.073452 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.073587 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.073741 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.073890 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074059 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074222 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074361 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074515 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074685 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074828 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.074965 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075102 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075237 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075407 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075557 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075696 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075843 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.075980 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.076116 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.076261 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.076426 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.076578 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.076771 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.076944 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.077104 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.077260 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.077398 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.077535 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.077702 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.077864 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078012 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078149 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078328 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078472 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078647 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078791 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.078966 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.079119 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.079257 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.079393 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.079580 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.079734 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.079881 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.080020 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.080182 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.080399 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.080587 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.080725 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.080871 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081017 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081197 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081348 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081497 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081643 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081790 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.081952 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.082098 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.082291 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.082436 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.082595 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.082735 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.082919 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.083063 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.083237 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.083391 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.083610 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.083750 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.083912 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.084119 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.084265 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.084456 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.084601 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.084775 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.084921 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.085123 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.085272 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.085431 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.085585 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.085737 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.085886 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086033 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086179 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086317 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086461 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086599 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086744 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.086881 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087017 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087192 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087338 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087497 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087652 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087811 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.087950 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.088087 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.088225 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.088376 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.088515 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.088760 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.088916 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089087 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089243 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089392 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089532 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089669 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089816 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.089961 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.090099 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.090274 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.090562 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.090710 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.090849 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.090986 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091131 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091279 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091417 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091555 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091692 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091848 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.091994 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.092145 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.092285 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.092422 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.092560 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.092763 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.092915 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093112 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093257 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093395 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093532 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093681 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093845 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.093986 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.094122 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.094266 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.094404 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.094542 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.094688 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.094833 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095008 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095160 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095306 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095452 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095601 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095740 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.095932 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.096084 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.096245 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.096398 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.096559 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.096704 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.096869 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097014 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097210 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097367 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097529 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097683 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097830 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.097976 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.098142 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.098297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.098442 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.098578 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.098722 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.098861 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099005 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099143 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099317 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099470 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099619 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099757 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.099908 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.100047 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.100205 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.100357 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.100514 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.100754 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.100907 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.101106 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.101254 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.101403 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.101552 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.101697 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.101845 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102000 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102142 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102279 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102416 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102561 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102699 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102836 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.102980 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103126 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103263 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103423 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103562 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103706 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103844 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.103980 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.104125 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.104271 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.104409 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.104545 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.104719 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.104873 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105056 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105219 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105508 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105670 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105817 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.105986 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.106635 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.106803 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.106947 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.107109 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.107255 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.107468 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.107609 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.107747 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.107895 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108033 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108178 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108469 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108614 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108753 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.108890 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109027 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109207 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109348 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109494 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109632 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109782 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.109928 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.110068 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.110214 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.110352 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.110489 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.110649 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.110913 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.111619 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.111762 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.111901 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112038 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112038 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112323 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112323 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112604 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112742 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.112887 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113070 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113217 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113356 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113492 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113492 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113753 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.113753 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114035 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114173 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114309 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114446 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114731 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.114876 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115014 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115151 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115289 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115435 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115573 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115726 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.115871 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116009 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116146 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116297 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116442 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116580 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116717 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116853 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.116990 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.117164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.117305 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.117442 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.117589 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.117727 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.117873 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118012 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118156 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118430 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118567 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118712 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118850 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.118998 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119136 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119273 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119419 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119565 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119704 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119849 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.119986 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.120123 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.120284 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.120439 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.120618 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.120761 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.121024 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.121193 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.121344 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.121503 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.121641 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.121831 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.122476 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.122641 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.122803 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.122951 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.123094 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.123238 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.123382 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.123525 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.123682 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.123847 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124000 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124145 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124288 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124431 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124612 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124771 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.124924 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.125140 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.125305 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.125464 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.125616 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.125761 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.125915 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126059 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126203 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126354 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126498 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126642 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126785 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.126928 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.127071 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.127228 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.127687 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.127840 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.127983 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.128138 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.128282 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.128435 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.128579 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.128723 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.128867 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129010 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129242 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129391 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129534 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129678 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129828 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.129973 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.130139 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.130285 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.130437 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.130582 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.130725 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.130868 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.131124 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.131285 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.131431 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.131575 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.131719 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.131862 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132029 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132174 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132324 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132469 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132620 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132776 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.132921 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.133095 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.133246 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.133390 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.133534 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.133686 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.133857 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134026 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134172 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134322 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134473 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134627 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134778 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.134930 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.135074 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.135216 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.135417 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.135585 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.135763 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.136096 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.136321 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.136494 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.136651 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.136805 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.136956 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.137175 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.137332 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.137977 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.138134 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.138280 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.138438 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.138591 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.138749 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.138894 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139045 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139196 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139349 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139502 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139646 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139797 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.139942 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140098 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140252 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140397 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140540 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140695 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140841 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.140993 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141187 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141287 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141368 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141579 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141688 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141904 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.141995 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.142231 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.142318 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.142535 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.142624 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.142845 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.142935 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.143154 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.143250 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.143463 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.143574 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.143766 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.143886 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.144069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.144197 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.144389 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.144514 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.144693 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.144823 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145013 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145157 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145347 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145487 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145669 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145797 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.145990 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.146111 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.146292 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.146427 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.146613 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.146744 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.146922 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147054 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147225 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147360 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147528 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147679 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147831 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.147990 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.148171 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.148317 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.148474 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.148636 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.148793 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.148965 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.149145 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.149317 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.149473 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.149626 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.149782 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.149954 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.150112 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.150270 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.150434 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.150580 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.150752 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.150888 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151070 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151198 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151390 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151545 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151698 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151855 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.151998 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.152180 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.152306 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.152515 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.152600 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.152847 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.152935 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.153731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.153851 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.154072 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.154159 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.154405 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.154495 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.154729 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.154816 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155035 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155121 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155357 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155453 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155661 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155748 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.155968 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156052 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156277 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156580 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156665 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156884 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.156980 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.157209 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.157298 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.157523 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.157608 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.157833 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.157932 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.158142 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.158228 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.158451 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.158537 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.158771 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.158864 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.159084 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.159170 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.159397 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.159482 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.159710 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.159805 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160026 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160112 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160334 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160425 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160644 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160737 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.160954 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.161096 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.161288 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.161416 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.161602 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.161697 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.161919 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.162016 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.162237 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.162332 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.162565 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.162787 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.162874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.163114 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.163201 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.163428 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.163524 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.163742 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.163830 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164056 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164142 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164466 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164681 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164767 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.164992 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.165106 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.165330 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.165426 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.165642 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.165729 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.165955 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.166201 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.166300 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.166539 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.166625 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.166860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.166980 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.167181 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.167316 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.167502 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.167636 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.167822 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.167948 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.168141 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.168262 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.168459 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.168571 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.168808 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.168951 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.169159 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.169288 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.169479 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.169592 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.169813 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.169913 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.170141 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.170229 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.170472 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.170559 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.170803 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.170905 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.171113 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.171207 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.171424 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.171518 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.171739 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.171835 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172050 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172140 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172358 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172445 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172668 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172756 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.172976 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.173114 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.173326 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.173412 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.173651 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.173738 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.173967 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174059 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174279 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174388 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174591 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174677 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174901 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.174986 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.175218 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.175419 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.175536 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.175738 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.175853 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.176418 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.176516 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.176648 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.176736 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.176815 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.177088 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.177179 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.177411 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.177501 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.177733 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.177819 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.178061 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.178147 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.178370 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.178465 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.178677 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.178894 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.179062 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.179212 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.179384 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.179540 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.179690 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.179872 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180016 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180204 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180526 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180635 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180850 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.180956 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.181204 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.181306 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.181517 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.181825 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.181912 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.182148 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.182271 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.182461 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.182585 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.182883 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.183030 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.183208 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.183367 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.183526 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.183691 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.183832 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.184003 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.184156 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.184360 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.184490 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.184678 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.184796 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.185141 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.185244 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.185454 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.185592 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.185759 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.185915 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.186065 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.186246 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.186376 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.186578 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.186687 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.186902 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187039 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187216 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187305 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187547 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187633 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187859 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.187945 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.188168 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.188261 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.188469 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.188554 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.188774 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.188869 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.189107 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.189270 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.189415 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.189509 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.189721 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.189821 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190030 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190117 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190332 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190417 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190642 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190736 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.190947 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.191040 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.191254 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.191375 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.191556 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.191720 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.191870 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.192075 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.192205 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.192431 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.192598 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.192787 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.192874 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.193131 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.193234 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.193438 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.193533 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.193740 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.193840 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194055 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194189 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194365 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194551 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194685 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194886 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.194978 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.195237 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.195324 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.195598 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.195685 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.195923 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.196008 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.196275 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.196449 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.196596 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.196779 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.196948 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.197119 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.197303 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.197454 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.197614 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.197787 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.197922 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.198168 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.198279 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.198475 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.198611 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.198779 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.198917 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.199101 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.199235 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.199413 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.199552 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.199724 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.200440 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.200567 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.200767 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.200881 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.201215 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.201338 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.201526 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.201679 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.201839 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202006 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202150 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202347 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202460 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202686 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202784 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.202999 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.203085 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.203310 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.203396 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.203627 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.203715 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.203954 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204039 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204268 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204362 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204583 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204669 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204900 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.204987 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.205240 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.205338 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.205555 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.205641 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.205867 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.205959 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.206177 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.206272 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.206487 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.206574 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.206796 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.206891 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.207104 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.207204 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.207416 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.207501 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.207729 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.207822 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.208039 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.208137 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.208343 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.208442 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.208658 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.208743 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209006 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209169 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209352 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209439 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209676 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209775 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.209983 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.210070 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.210301 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.210387 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.210612 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.210696 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.210918 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211005 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211230 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211315 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211538 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211622 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211855 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.211951 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.212189 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.212277 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.212509 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.212611 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.212817 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.212905 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.213142 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.213269 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.213480 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.213626 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.213826 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.213961 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.214135 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.214367 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.214455 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.214686 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.214782 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.215013 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.215100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.215320 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.215413 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.216195 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.216300 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.216518 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.216604 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.216821 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.216916 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.217147 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.217236 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.217454 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.217541 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.217765 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.217868 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218068 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218154 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218371 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218476 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218670 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218764 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.218970 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219057 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219271 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219365 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219573 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219661 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219880 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.219966 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.220182 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.220269 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.220486 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.220574 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.220788 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.220882 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.221111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.221203 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.221414 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.221507 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.221745 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.221867 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222054 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222157 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222371 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222494 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222683 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222769 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.222991 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.223152 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.223361 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.223453 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.223605 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.223691 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.223909 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224007 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224216 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224310 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224530 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224616 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224837 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.224934 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.225172 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.225261 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.225482 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.225569 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.225791 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.225880 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.226099 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.226186 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.226434 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.226521 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.226749 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.226837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227059 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227154 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227384 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227474 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227697 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227812 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.227998 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.228093 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.228321 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.228407 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.228637 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.228724 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.228953 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.229067 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.229370 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.229480 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.229679 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.229785 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230006 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230104 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230315 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230415 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230624 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230718 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.230935 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231022 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231268 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231369 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231578 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231665 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231897 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.231983 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.232204 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.232300 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.232513 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.232654 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.232828 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.232922 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.233165 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.233257 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.233492 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.233579 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.233817 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.233915 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.234126 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.234216 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.234447 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.234536 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.234772 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.234867 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.235097 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.235183 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.235413 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.235499 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.235733 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.235827 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236049 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236137 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236362 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236454 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236671 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236770 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.236975 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.237121 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.237241 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:17:33.237379 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.237624 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.237947 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.238281 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.238612 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.238928 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.239259 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.239589 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.239938 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.240259 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.240607 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.240941 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.241283 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.241601 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.241910 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:17:33.242158 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:17:33.393457 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Registered counter for database nova_api Aug 30 04:17:33.397910 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Registered counter for database nova_api Aug 30 04:17:33.413257 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.417475 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.419930 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.424192 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.476905 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.context [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b898ea9-960d-4dcf-9a7e-e7ae17af48ca(cell1) {{(pid=105475) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:17:33.480822 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.481339 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.481462 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.context [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b898ea9-960d-4dcf-9a7e-e7ae17af48ca(cell1) {{(pid=105476) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:17:33.483033 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.483792 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.484214 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.485230 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.485724 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.486208 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.487306 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.488044 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.488164 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Registered counter for database nova_cell0 Aug 30 04:17:33.488493 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.490509 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.492475 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Registered counter for database nova_cell0 Aug 30 04:17:33.492649 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Registered counter for database nova_cell1 Aug 30 04:17:33.496498 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Registered counter for database nova_cell1 Aug 30 04:17:33.501811 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.503418 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.504175 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.506993 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.509297 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.646012 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.646220 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.651396 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.655611 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Registered counter for database nova_cell0 Aug 30 04:17:33.661023 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Registered counter for database nova_cell0 Aug 30 04:17:33.664396 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.669622 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:17:33.669773 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:33.674391 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:17:34.007517 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:17:34.008280 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:17:34.014856 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:17:34.015591 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:17:34.358023 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:17:34.361945 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:17:34.363880 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:17:34.367878 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-6ceda61d-7579-4a47-8c69-c9be134c5a81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:17:34.369125 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e03aade9c0 pid: 105475 (default app) Aug 30 04:17:34.371279 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:34.372995 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002258 Aug 30 04:17:34.373423 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Tue Aug 30 04:17:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:34.373751 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e03aade9c0 pid: 105476 (default app) Aug 30 04:18:53.313666 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:53.314595 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 04:18:53.314989 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:53.327281 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:53.328680 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:53.329707 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell1:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:53.330908 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:54.166720 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-3fcd59f1-014b-4132-ba90-6d14fe7ac4d7 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:54.198571 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-3fcd59f1-014b-4132-ba90-6d14fe7ac4d7 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.876396 Aug 30 04:18:54.199418 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1292 bytes} [Tue Aug 30 04:18:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:56.578913 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:56.580085 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-270b8c45-8745-4d28-bdf7-40ea326d0996 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Aug 30 04:18:56.580746 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:57.054912 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-95917c8d-f378-40d4-ac75-b042d8a430e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1", "ram": 256}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:57.108621 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-95917c8d-f378-40d4-ac75-b042d8a430e8 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519095 Aug 30 04:18:57.109367 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:18:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:57.123795 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:57.125180 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell1:SELECT=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:57.126227 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell0:SELECT=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:57.127236 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:57.336126 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f94af7ea-2901-401a-b021-54152ecaec0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:57.403195 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f94af7ea-2901-401a-b021-54152ecaec0e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285179 Aug 30 04:18:57.409272 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1336 bytes} [Tue Aug 30 04:18:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:59.819987 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-95917c8d-f378-40d4-ac75-b042d8a430e8 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:59.821015 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-95917c8d-f378-40d4-ac75-b042d8a430e8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 30 04:18:59.821748 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:00.511681 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-24a6ef0d-eb7d-459c-bf9a-5aa5ed94e4fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:00.552159 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-24a6ef0d-eb7d-459c-bf9a-5aa5ed94e4fd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724272 Aug 30 04:19:00.560671 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:18:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:00.566116 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-530d8e36-a13d-41ae-9b87-e950e8d14f22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:00.609821 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-530d8e36-a13d-41ae-9b87-e950e8d14f22 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047194 Aug 30 04:19:00.610788 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1336 bytes} [Tue Aug 30 04:19:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:03.047143 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-24a6ef0d-eb7d-459c-bf9a-5aa5ed94e4fd admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:03.048160 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-24a6ef0d-eb7d-459c-bf9a-5aa5ed94e4fd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 30 04:19:03.048555 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:03.403197 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-f5565f1b-3f5c-4309-815d-073a182b10df admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "vcpus": 1, "ram": 1024}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:03.423904 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-f5565f1b-3f5c-4309-815d-073a182b10df admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.369119 Aug 30 04:19:03.424638 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:19:03.436311 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f6e0517d-34a8-4135-8bdb-02e098fff554 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:03.461776 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f6e0517d-34a8-4135-8bdb-02e098fff554 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029063 Aug 30 04:19:03.462847 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1336 bytes} [Tue Aug 30 04:19:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:05.843584 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-f5565f1b-3f5c-4309-815d-073a182b10df admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:05.844635 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-f5565f1b-3f5c-4309-815d-073a182b10df admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 30 04:19:05.845067 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:06.290853 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-e82d0ed5-7270-4489-b073-9fe771b95e65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "ram": 2048, "name": "ds2G", "vcpus": 2}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:06.326148 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-e82d0ed5-7270-4489-b073-9fe771b95e65 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474933 Aug 30 04:19:06.327067 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:06.341272 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-7be39dbe-ee51-4d6e-9351-3b4a4ab45a85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:06.372856 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-7be39dbe-ee51-4d6e-9351-3b4a4ab45a85 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035722 Aug 30 04:19:06.380565 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1336 bytes} [Tue Aug 30 04:19:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:08.795034 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-e82d0ed5-7270-4489-b073-9fe771b95e65 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:08.797011 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-e82d0ed5-7270-4489-b073-9fe771b95e65 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Aug 30 04:19:08.797360 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:09.273568 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5ae8f49a-9bf1-49d0-80fd-4d1bcf45bdc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:09.296400 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5ae8f49a-9bf1-49d0-80fd-4d1bcf45bdc9 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492826 Aug 30 04:19:09.297380 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:09.310263 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-8a6f60db-54f1-4eb3-bc11-4e7d8945607a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:09.337843 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-8a6f60db-54f1-4eb3-bc11-4e7d8945607a admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031854 Aug 30 04:19:09.349065 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1336 bytes} [Tue Aug 30 04:19:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:11.779519 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5ae8f49a-9bf1-49d0-80fd-4d1bcf45bdc9 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:11.781464 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5ae8f49a-9bf1-49d0-80fd-4d1bcf45bdc9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002516 Aug 30 04:19:11.781880 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:12.228425 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-a1d45e31-6d15-4528-86e1-a71512d6fed7 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:12.254126 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-a1d45e31-6d15-4528-86e1-a71512d6fed7 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465348 Aug 30 04:19:12.254660 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1292 bytes} [Tue Aug 30 04:19:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:14.657493 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5ae8f49a-9bf1-49d0-80fd-4d1bcf45bdc9 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.658417 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5ae8f49a-9bf1-49d0-80fd-4d1bcf45bdc9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 04:19:14.658818 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:15.128343 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-5e44cb9b-47bc-4728-b2c6-4cbceb43a135 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "id": "1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:15.150868 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-5e44cb9b-47bc-4728-b2c6-4cbceb43a135 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485322 Aug 30 04:19:15.151411 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:19:15.170651 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-2da59fe9-26c3-4ac6-83df-ba1dc29a3081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:15.212807 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-2da59fe9-26c3-4ac6-83df-ba1dc29a3081 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051804 Aug 30 04:19:15.213732 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1333 bytes} [Tue Aug 30 04:19:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:17.802508 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-5e44cb9b-47bc-4728-b2c6-4cbceb43a135 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:17.803525 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-5e44cb9b-47bc-4728-b2c6-4cbceb43a135 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 30 04:19:17.803930 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:18.277799 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ca84358a-fe32-4639-99cd-d76f613138c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:18.298053 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ca84358a-fe32-4639-99cd-d76f613138c4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485905 Aug 30 04:19:18.298601 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:19:18.312073 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-6ea75322-9252-4a25-b4e4-d6f2239c77fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:18.338094 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-6ea75322-9252-4a25-b4e4-d6f2239c77fd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030180 Aug 30 04:19:18.338584 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1333 bytes} [Tue Aug 30 04:19:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:20.781457 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ca84358a-fe32-4639-99cd-d76f613138c4 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:20.782427 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ca84358a-fe32-4639-99cd-d76f613138c4 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 Aug 30 04:19:20.783129 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:21.241271 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-d3222bfd-8287-4c5c-969b-2679969cdb5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "ram": 4096, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:21.262393 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-d3222bfd-8287-4c5c-969b-2679969cdb5e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.473134 Aug 30 04:19:21.263309 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:21.276248 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-8d38cf34-cbd4-46b7-a9e9-beb717063bff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:21.302371 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-8d38cf34-cbd4-46b7-a9e9-beb717063bff admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030250 Aug 30 04:19:21.309080 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1333 bytes} [Tue Aug 30 04:19:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:23.712113 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-d3222bfd-8287-4c5c-969b-2679969cdb5e admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.713850 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-d3222bfd-8287-4c5c-969b-2679969cdb5e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 Aug 30 04:19:23.714504 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:24.188732 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-28cb0ca8-0196-4cbd-926d-ef1ebdab261d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "ram": 8192}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:24.194791 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:24.212392 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-28cb0ca8-0196-4cbd-926d-ef1ebdab261d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491022 Aug 30 04:19:24.213277 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:19:24.224861 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-bbbfccd6-6a26-4b33-b278-8a72401e907c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:24.251438 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-bbbfccd6-6a26-4b33-b278-8a72401e907c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030151 Aug 30 04:19:24.252301 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1333 bytes} [Tue Aug 30 04:19:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:26.697094 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-28cb0ca8-0196-4cbd-926d-ef1ebdab261d admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:26.698116 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-28cb0ca8-0196-4cbd-926d-ef1ebdab261d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 30 04:19:26.698524 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:27.180344 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-5ddc1143-4e66-45b2-815c-e0a54044ba3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "rxtx_factor": 1.0}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:27.202926 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-5ddc1143-4e66-45b2-815c-e0a54044ba3e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497903 Aug 30 04:19:27.203863 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1283 bytes} [Tue Aug 30 04:19:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:27.216617 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-56499e80-ec71-4e57-adc4-bd6e2899975f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:27.247973 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-56499e80-ec71-4e57-adc4-bd6e2899975f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034876 Aug 30 04:19:27.248534 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1333 bytes} [Tue Aug 30 04:19:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:46.540206 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-5ddc1143-4e66-45b2-815c-e0a54044ba3e admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.541253 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-5ddc1143-4e66-45b2-815c-e0a54044ba3e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 30 04:19:46.541674 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:46.552432 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:46.936051 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-163cf1d6-055c-469d-b597-10acdabb5c9f admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.955839 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-163cf1d6-055c-469d-b597-10acdabb5c9f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407928 Aug 30 04:19:46.956372 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1292 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:48.042450 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-5ddc1143-4e66-45b2-815c-e0a54044ba3e admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.043457 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-5ddc1143-4e66-45b2-815c-e0a54044ba3e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 30 04:19:48.043852 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:48.574862 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-e04fe0bd-7504-4fa0-aede-16f4c1fa1efc admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.580532 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-e04fe0bd-7504-4fa0-aede-16f4c1fa1efc admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-e04fe0bd-7504-4fa0-aede-16f4c1fa1efc admin admin] Request method failure captured: Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Accept: application/json Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Connection: keep-alive Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Content-Length: 0 Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Host: 10.222.0.85 Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.90 Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjDY_jnEfz0qPWTsL9Gy4tgVubRT5X-Qtu_XSC_2DwuZCw5r88i7zLuVsVqHRa9kIcgXewcM-0ybN_3y_WcXcnZTw4g7SDSPsL2hIhTms2ZECer6vGWt39jr3XVnXBQrVxgS44CkYL3jt1d4lBBmZll8eg7eqrUN_o5ZVX96k4gf74c4Y Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Role: member,admin,reader Aug 30 04:19:48.583874 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Roles: member,admin,reader Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_be2e356bbe7d4680bd52a62e89c77545"}]}] Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant: admin Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User: admin Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Id: a85a3472aa4a4c95a2bc16b6450e8dcd Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Name: admin Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: method: > Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: exception: Flavor 42 could not be found. Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: action_args: {'id': '42'} Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:48.586164 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:48.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.588860 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-e04fe0bd-7504-4fa0-aede-16f4c1fa1efc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:48.590169 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-e04fe0bd-7504-4fa0-aede-16f4c1fa1efc admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.404445 Aug 30 04:19:48.590169 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:19:48.595793 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-aeb7227d-2c07-4664-b504-a830b111962d admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.600182 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:48.622949 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-aeb7227d-2c07-4664-b504-a830b111962d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030777 Aug 30 04:19:48.623512 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:48.633769 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-4a70cb43-93c0-4c88-b32a-602c400e2f6d admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.656865 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-4a70cb43-93c0-4c88-b32a-602c400e2f6d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026662 Aug 30 04:19:48.657438 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:48.668237 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-45ae92ab-b763-4307-9040-978ad2258264 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.674753 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.wsgi [None req-45ae92ab-b763-4307-9040-978ad2258264 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-45ae92ab-b763-4307-9040-978ad2258264 admin admin] Request method failure captured: Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Accept: application/json Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Accept-Encoding: gzip, deflate Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Connection: keep-alive Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Content-Length: 0 Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Host: 10.222.0.85 Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Openstack-Api-Version: compute 2.90 Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Openstack-System-Scope: None Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: User-Agent: python-novaclient Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Auth-Token: gAAAAABjDY_jnEfz0qPWTsL9Gy4tgVubRT5X-Qtu_XSC_2DwuZCw5r88i7zLuVsVqHRa9kIcgXewcM-0ybN_3y_WcXcnZTw4g7SDSPsL2hIhTms2ZECer6vGWt39jr3XVnXBQrVxgS44CkYL3jt1d4lBBmZll8eg7eqrUN_o5ZVX96k4gf74c4Y Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Domain-Id: None Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Domain-Name: None Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Identity-Status: Confirmed Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Is-Admin-Project: True Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Domain-Id: default Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Domain-Name: Default Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Name: admin Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Role: member,admin,reader Aug 30 04:19:48.678369 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Roles: member,admin,reader Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_be2e356bbe7d4680bd52a62e89c77545"}]}] Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant: admin Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant-Name: admin Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User: admin Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Domain-Id: default Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Domain-Name: Default Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Id: a85a3472aa4a4c95a2bc16b6450e8dcd Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Name: admin Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: method: > Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: exception: Flavor 42 could not be found. Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: action_args: {'id': '42'} Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:48.681331 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:48.683152 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:48.685069 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-45ae92ab-b763-4307-9040-978ad2258264 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:48.687009 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-45ae92ab-b763-4307-9040-978ad2258264 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017105 Aug 30 04:19:48.687009 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:49.653101 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-4a70cb43-93c0-4c88-b32a-602c400e2f6d admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.654143 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-4a70cb43-93c0-4c88-b32a-602c400e2f6d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 30 04:19:49.654535 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:50.197227 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-7bfd443c-341b-43e4-bb94-a56a2b685658 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.203072 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.wsgi [None req-7bfd443c-341b-43e4-bb94-a56a2b685658 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-7bfd443c-341b-43e4-bb94-a56a2b685658 admin admin] Request method failure captured: Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Accept: application/json Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Accept-Encoding: gzip, deflate Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Connection: keep-alive Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Content-Length: 0 Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Host: 10.222.0.85 Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Openstack-Api-Version: compute 2.90 Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Openstack-System-Scope: None Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: User-Agent: python-novaclient Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Auth-Token: gAAAAABjDY_l0AF-ijGyYq7fA8vy3x1zxyMjHHaha2vSBNPCv2YYjCBN7oZYMlo3s9rkEsKR_SfpYYF3oRei2EE4y9E4Nxlj4_9kWaAC4V8sZR9B4QbUU7XN4Sg8xmjyvhhAwRh5JuH4GbSKRN-pYo2SeCgnq4UWRwpnoBbX34UHSqdVJTiG8ZY Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Domain-Id: None Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Domain-Name: None Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Identity-Status: Confirmed Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Is-Admin-Project: True Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Domain-Id: default Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Domain-Name: Default Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Name: admin Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Role: member,admin,reader Aug 30 04:19:50.204568 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Roles: member,admin,reader Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_be2e356bbe7d4680bd52a62e89c77545"}]}] Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant: admin Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant-Name: admin Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User: admin Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Domain-Id: default Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Domain-Name: Default Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Id: a85a3472aa4a4c95a2bc16b6450e8dcd Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Name: admin Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: method: > Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: exception: Flavor 84 could not be found. Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: action_args: {'id': '84'} Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:50.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:50.207111 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.208522 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-7bfd443c-341b-43e4-bb94-a56a2b685658 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:50.209853 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-7bfd443c-341b-43e4-bb94-a56a2b685658 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412002 Aug 30 04:19:50.209853 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:50.215610 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-9b3e46c2-0b69-4015-b162-8335126c5764 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.230934 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-9b3e46c2-0b69-4015-b162-8335126c5764 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018895 Aug 30 04:19:50.231461 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:50.240934 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-048b1117-107f-454f-909b-04ed4c11890f admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.257650 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-048b1117-107f-454f-909b-04ed4c11890f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019778 Aug 30 04:19:50.258185 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:50.267541 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ccfe1e5d-543e-4cfc-8d5f-150aa219dd82 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.273486 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-ccfe1e5d-543e-4cfc-8d5f-150aa219dd82 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ccfe1e5d-543e-4cfc-8d5f-150aa219dd82 admin admin] Request method failure captured: Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Accept: application/json Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Connection: keep-alive Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Content-Length: 0 Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Host: 10.222.0.85 Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.90 Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjDY_l0AF-ijGyYq7fA8vy3x1zxyMjHHaha2vSBNPCv2YYjCBN7oZYMlo3s9rkEsKR_SfpYYF3oRei2EE4y9E4Nxlj4_9kWaAC4V8sZR9B4QbUU7XN4Sg8xmjyvhhAwRh5JuH4GbSKRN-pYo2SeCgnq4UWRwpnoBbX34UHSqdVJTiG8ZY Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Role: member,admin,reader Aug 30 04:19:50.275294 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Roles: member,admin,reader Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_be2e356bbe7d4680bd52a62e89c77545"}]}] Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant: admin Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User: admin Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Id: a85a3472aa4a4c95a2bc16b6450e8dcd Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Name: admin Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: method: > Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: exception: Flavor 84 could not be found. Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: action_args: {'id': '84'} Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:50.276783 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:50.277837 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:50.279593 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ccfe1e5d-543e-4cfc-8d5f-150aa219dd82 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:50.280822 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ccfe1e5d-543e-4cfc-8d5f-150aa219dd82 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012620 Aug 30 04:19:50.280822 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:19:51.253487 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-048b1117-107f-454f-909b-04ed4c11890f admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.254555 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-048b1117-107f-454f-909b-04ed4c11890f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 30 04:19:51.254948 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:51.786762 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d63aa843-a0c0-4839-aec1-2b8b867e25b5 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.793238 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-d63aa843-a0c0-4839-aec1-2b8b867e25b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d63aa843-a0c0-4839-aec1-2b8b867e25b5 admin admin] Request method failure captured: Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Accept: application/json Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Connection: keep-alive Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Content-Length: 0 Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Host: 10.222.0.85 Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.90 Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjDY_nGOecmwqxQ1i5l0JT9GTUXimGzqJQaWzxmOPonl2W61EaRFzTvHJG84LrZ62XZoQ2bhwyjOB5_Q6KsGOz332jNnh9oLf4eNTRVJ-0bub1Kr4yxCPyoRdFPZ6beKAHbbeXOM0HemFNwH8IR0FCdw2aQmb2128731fCsL_YqN7_RRs Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Role: member,admin,reader Aug 30 04:19:51.795588 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Roles: member,admin,reader Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_be2e356bbe7d4680bd52a62e89c77545"}]}] Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant: admin Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User: admin Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Id: a85a3472aa4a4c95a2bc16b6450e8dcd Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: X-User-Name: admin Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: method: > Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: exception: Flavor 451 could not be found. Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: action_args: {'id': '451'} Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:51.797202 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:51.798358 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.799731 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d63aa843-a0c0-4839-aec1-2b8b867e25b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:51.800977 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d63aa843-a0c0-4839-aec1-2b8b867e25b5 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405541 Aug 30 04:19:51.800977 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:51.807317 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3b9737e9-da30-4a8d-b7e2-9ec3383f70f0 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.822720 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-3b9737e9-da30-4a8d-b7e2-9ec3383f70f0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019600 Aug 30 04:19:51.823281 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:51.832677 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.847795 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018646 Aug 30 04:19:51.848319 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:51.858580 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3e595af9-ca70-4680-9ff7-3cf39d7a05c2 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.863981 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.wsgi [None req-3e595af9-ca70-4680-9ff7-3cf39d7a05c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3e595af9-ca70-4680-9ff7-3cf39d7a05c2 admin admin] Request method failure captured: Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Accept: application/json Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Accept-Encoding: gzip, deflate Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Connection: keep-alive Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Content-Length: 0 Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Host: 10.222.0.85 Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Openstack-Api-Version: compute 2.90 Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Openstack-System-Scope: None Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: User-Agent: python-novaclient Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Auth-Token: gAAAAABjDY_nGOecmwqxQ1i5l0JT9GTUXimGzqJQaWzxmOPonl2W61EaRFzTvHJG84LrZ62XZoQ2bhwyjOB5_Q6KsGOz332jNnh9oLf4eNTRVJ-0bub1Kr4yxCPyoRdFPZ6beKAHbbeXOM0HemFNwH8IR0FCdw2aQmb2128731fCsL_YqN7_RRs Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Domain-Id: None Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Domain-Name: None Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Identity-Status: Confirmed Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Is-Admin-Project: True Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Domain-Id: default Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Domain-Name: Default Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Project-Name: admin Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Role: member,admin,reader Aug 30 04:19:51.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Roles: member,admin,reader Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/be2e356bbe7d4680bd52a62e89c77545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_be2e356bbe7d4680bd52a62e89c77545"}]}] Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant: admin Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant-Id: be2e356bbe7d4680bd52a62e89c77545 Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-Tenant-Name: admin Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User: admin Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Domain-Id: default Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Domain-Name: Default Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Id: a85a3472aa4a4c95a2bc16b6450e8dcd Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: X-User-Name: admin Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: method: > Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: exception: Flavor 451 could not be found. Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: action_args: {'id': '451'} Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:51.868297 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:51.869405 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Aug 30 04:19:51.870809 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3e595af9-ca70-4680-9ff7-3cf39d7a05c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:51.872668 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-3e595af9-ca70-4680-9ff7-3cf39d7a05c2 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012645 Aug 30 04:19:51.872668 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:52.840387 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:52.841482 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 30 04:19:52.841880 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:53.381827 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-9090938a-e46c-4320-98b6-2f0649d286fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:53.400560 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-9090938a-e46c-4320-98b6-2f0649d286fc admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.412117 Aug 30 04:19:53.401126 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Aug 30 04:19:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:19:54.383190 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.384206 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Aug 30 04:19:54.384605 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:54.908414 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-25ba026b-c5ab-45dd-a6c2-6126fde9488d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:54.926834 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-25ba026b-c5ab-45dd-a6c2-6126fde9488d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405918 Aug 30 04:19:54.927316 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Aug 30 04:19:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:55.902520 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.903569 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 30 04:19:55.903964 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:56.438572 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c56aecb5-1e9f-43a5-ada5-f8e237c8b0be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:56.458620 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-c56aecb5-1e9f-43a5-ada5-f8e237c8b0be admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.413930 Aug 30 04:19:56.459159 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Aug 30 04:19:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:57.449726 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.450787 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 30 04:19:57.451212 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:57.982628 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-10233bd2-2469-4a35-b1fb-72e4e4dabc4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:58.002656 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-10233bd2-2469-4a35-b1fb-72e4e4dabc4c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411300 Aug 30 04:19:58.003127 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Aug 30 04:19:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:58.984896 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:58.986001 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 30 04:19:58.986398 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:59.510908 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-1b42b924-c501-4d00-b465-931aa4c30543 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:59.531787 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-1b42b924-c501-4d00-b465-931aa4c30543 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408581 Aug 30 04:19:59.532333 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Tue Aug 30 04:19:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:53.475152 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.476081 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37ca4bba-cdd3-459a-805b-811e76913dc0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 30 04:20:53.476502 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 931 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:53.486850 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:53.873274 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f025628f-4b4c-42b0-a40d-cc4162d00724 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.894447 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f025628f-4b4c-42b0-a40d-cc4162d00724 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411926 Aug 30 04:20:53.895005 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1292 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:53.918947 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=14 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:53.922885 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-59d461b8-f80e-4fcd-b677-a8ad05c2564a admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.931403 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-59d461b8-f80e-4fcd-b677-a8ad05c2564a admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013963 Aug 30 04:20:53.931923 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1283 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:53.944459 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c99f2574-04d3-479a-b14d-e142307021fc admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.952314 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-c99f2574-04d3-479a-b14d-e142307021fc admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011993 Aug 30 04:20:53.952876 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1286 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:53.965387 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.973213 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011366 Aug 30 04:20:53.973743 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1286 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:53.985402 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-ca00b4db-cbbb-4e39-99d5-a25fecf2e3e4 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.993290 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-ca00b4db-cbbb-4e39-99d5-a25fecf2e3e4 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011448 Aug 30 04:20:53.993847 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1283 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:02.141507 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.142507 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 04:24:02.142897 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:02.283873 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=6 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:02.442599 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.446096 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.446566 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.446987 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.447694 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.448134 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.448569 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.482967 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-00fe2df6-df5d-4e95-bfb8-16836e108287 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200544 Aug 30 04:24:02.483527 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:24:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:24:03.325960 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:03.326968 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 30 04:24:03.327364 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:03.542263 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:03.545706 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:03.546182 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:03.546607 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:03.547318 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:03.547759 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:03.548170 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:03.568343 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-fbf914f3-ca06-4d84-b522-984871541cd4 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.098996 Aug 30 04:24:03.568726 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:24:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:24:14.822285 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:14.823303 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 30 04:24:14.823705 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:14.968053 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell0:SELECT=4 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:14.968934 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell1:SELECT=4 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:14.969891 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=8 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:15.019298 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.023367 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.023865 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.024313 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.025016 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.025478 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.025938 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.044808 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-2fa887c7-e5c2-4ed3-ad78-d57503965744 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081156 Aug 30 04:24:15.045466 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:24:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:24:15.880708 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.882465 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Aug 30 04:24:15.882863 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:16.073439 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:16.077110 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:16.077299 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:16.077730 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:16.078450 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:16.078899 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:16.079315 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:16.099864 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-9438cd13-8d60-4c4f-94cb-1d99ab17229f admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078111 Aug 30 04:24:16.100989 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:24:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:24:27.355014 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:27.356014 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 30 04:24:27.356416 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 38/77] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:27.503425 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell0:SELECT=4 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:27.504172 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell1:SELECT=4 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:27.504889 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=8 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:27.553974 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:27.557396 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.557880 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.558307 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.559023 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.559470 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.559888 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.584667 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-59aec410-1b83-4ced-91be-cd542c555ce7 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085807 Aug 30 04:24:27.585237 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 40/78] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:24:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:28.426801 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:28.427841 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-670cd6f9-296b-4ff6-a802-6d98e075de69 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 04:24:28.428606 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 39/79] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Aug 30 04:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:28.620749 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:28.624370 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.624855 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.625315 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.626035 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.626479 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.626896 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.648888 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-d2b079f5-1959-4235-8c5e-4720e6ada879 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080765 Aug 30 04:24:28.649407 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 41/80] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Aug 30 04:24:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:28.371655 dv-cinder-854265-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 04:25:28.372952 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: Tue Aug 30 04:25:28 2022 - graceful shutdown triggered... Aug 30 04:25:28.373409 dv-cinder-854265-2-iscsi devstack@n-api.service[105475]: Gracefully killing worker 1 (pid: 105475)... Aug 30 04:25:28.373776 dv-cinder-854265-2-iscsi devstack@n-api.service[105476]: Gracefully killing worker 2 (pid: 105476)... Aug 30 04:25:29.372914 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: worker 1 buried after 1 seconds Aug 30 04:25:29.372914 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: worker 2 buried after 1 seconds Aug 30 04:25:29.372914 dv-cinder-854265-2-iscsi devstack@n-api.service[105474]: goodbye to uWSGI. Aug 30 04:25:29.374452 dv-cinder-854265-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 04:25:29.375005 dv-cinder-854265-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 04:25:29.377795 dv-cinder-854265-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:25:29.387879 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:25:29.390613 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:25:29 2022] *** Aug 30 04:25:29.390804 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:25:29.390990 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: nodename: dv-cinder-854265-2-iscsi Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: machine: x86_64 Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: clock source: unix Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: pcre jit disabled Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: detected number of CPU cores: 4 Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: current working directory: / Aug 30 04:25:29.391193 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: your processes number limit is 47680 Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: your memory page size is 4096 bytes Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: detected max file descriptor number: 2048 Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: lock engine: pthread robust mutexes Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: thunder lock: enabled Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:25:29.392316 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:25:29.431908 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: Python main interpreter initialized at 0x55802f8c49c0 Aug 30 04:25:29.431908 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: python threads support enabled Aug 30 04:25:29.431908 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: your server socket listen backlog is limited to 100 connections Aug 30 04:25:29.431908 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:25:29.432327 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:25:29.432327 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: *** Operational MODE: preforking *** Aug 30 04:25:29.432634 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:25:29.432634 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: spawned uWSGI master process (pid: 120700) Aug 30 04:25:29.432805 dv-cinder-854265-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:25:29.433342 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: spawned uWSGI worker 1 (pid: 120715, cores: 1) Aug 30 04:25:29.433913 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: spawned uWSGI worker 2 (pid: 120716, cores: 1) Aug 30 04:25:29.434210 dv-cinder-854265-2-iscsi devstack@n-api.service[120700]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:25:30.104018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:25:30.105377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:25:31.270488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:25:31.270488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: from cryptography.utils import int_from_bytes Aug 30 04:25:31.271758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:25:31.271758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: from cryptography.utils import int_from_bytes Aug 30 04:25:31.281861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:25:31.281861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: from cryptography.utils import int_from_bytes Aug 30 04:25:31.282378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:25:31.282378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: from cryptography.utils import int_from_bytes Aug 30 04:25:33.717847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:25:33.718523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:25:33.718523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:25:33.718880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:25:33.719064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:25:33.719446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.719785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.720110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.720434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.720945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.721316 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.722290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.722290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.722290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.722680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.722871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.723195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-iscsi {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.723525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.724379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.724702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.725053 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.725372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.725700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.726024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.726534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.726994 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.727308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.727624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.727973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.728303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.728607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.729072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.729496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.729602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.729920 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.730337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-iscsi {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.730664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.730990 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.731304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.731728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.732049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.732365 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.732689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.733018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.733357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.733692 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.734016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.734340 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.734666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.734970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.735281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.735653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.735979 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.736288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.736596 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.736850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.737198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.737527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.737850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.738178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.738589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.738703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.738996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.739324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.740213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.740528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.740838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.741354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.741837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.742165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.742479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.742792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.743124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.743450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.743780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.744093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.744416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.744831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.745293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.745612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.746257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.746547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.746862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.747189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.747516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.747829 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.748139 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.748449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.748773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.749144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.749457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.749712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.750018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.750328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.750651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.750960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.751264 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.751574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.751880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.752196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.752504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.752813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.753149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.753462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.753770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.754081 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.754387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.754694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.755062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.755392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.755701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.756014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.756320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.756630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.756954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.757293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.757603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.757930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.758237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.758546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.758870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.759179 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.759486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.759808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.760112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.760421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.760742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.761078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.761379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.761726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.761991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.762305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.762612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.762915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.763220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.763522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.763845 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.764171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.764486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.764796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.765131 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.765458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.765802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.766140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.766487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.766809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.767151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.767480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.767803 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.768115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.768434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.768780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.769103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.769422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.769734 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.770054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.770373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.770754 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.771077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.771395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.771715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.772021 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.772350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.772683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.773011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.773348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.773711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.774033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.774350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.774677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.775004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.775321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.775633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.775944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.776273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.776612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.776925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.777289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.777589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.777918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.778237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.778548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.778862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.779180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.779492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.779837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.780159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.780486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.780805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.781154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.781465 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.781780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.782101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.782416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.782723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.783039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.783331 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.783640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.783946 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.784272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.784607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.784918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.785295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.785531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:25:33.786035 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.786192 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:25:33.786894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.786894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.787196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:25:33.787352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.787504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:25:33.787870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.788031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:25:33.788176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.788369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.788604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.788604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.788885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.789026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.789237 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.789565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.789733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.789876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.790024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.790182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.790413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.790607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.790607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.790893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.791034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.791180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.791424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.791577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.791738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.791886 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.792027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.792173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.792323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.792471 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-2-iscsi {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.792618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.792926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.793198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.793358 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.793509 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.793659 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.793807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.793966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.794115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.794269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.794486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.794634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.794774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.794913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.795052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.795052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.795886 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.796061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.796203 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.796350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.796501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.796642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.796788 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.796938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.797110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.797274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.797424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.797565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.797565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.798089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.798250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.798408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.798807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.798966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.799116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.799443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.799662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.800121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.800271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.800446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-2-iscsi {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.800683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.800835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.800976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.801141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.801295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.801295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.801693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.801847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.801847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.802918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.803082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.803369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.803647 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.803818 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.803972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.804121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.804272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.804413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.804560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.804560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.804830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.804986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.805186 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.805336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.805484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.805625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.805771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.805922 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.806063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.806210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.806351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.806498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.806645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.806794 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.806944 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.807109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.807252 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.807392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.807546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.807688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.807837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.808129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.808372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.808519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.808668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.808825 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.809087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.809240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.809391 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.809532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.809700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.809929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.810092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.810310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.810457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.810611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.810866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.811029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.811173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.811341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.811483 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.811630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.811875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.812036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.812185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.812326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.812473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.812613 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.812761 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.812901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.813059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.813218 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.813481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.813638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.813797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.813945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.814093 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.814241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.814390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.814530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.814682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.814831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.814979 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.815119 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.815266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.815429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.815580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.815721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.815860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.816005 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.816146 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.816299 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.816450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.816591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.816731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.816870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.817009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.817230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.817381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.817559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.817559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.817841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.817989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.818513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.818667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.818808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.818985 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.819360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.819530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.819692 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.819853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.820087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.820235 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.820464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.820626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.820777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.821018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.821198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.821342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.821482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.821630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.821783 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.822043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.822202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.822351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.822503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.822693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.822849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.822998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.823151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.823298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.823548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.823710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.823861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.824171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.824351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.824513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.824663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.824819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.825004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.825205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.825347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.825488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.825645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.825796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.825938 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.826078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.826226 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.826374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.826539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.826688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.826837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.826991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.827132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.827279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.827432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.827573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.827713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.827867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.828025 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.828173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.828431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.828596 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.828835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.828991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.829157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.829316 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.829551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.829704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.829852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.830002 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.830260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.830417 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.830652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.830808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.830964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.831217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.831364 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.831504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.831644 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.831801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.831951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.832194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.832349 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.832499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.832648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.832648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.832945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.833750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.833924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.834081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.834239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.834395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.834395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.834690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.834866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.835103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.835256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.835414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.835571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.835736 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.835891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.836045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.836201 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.836364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.836364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.836666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.836821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.836982 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.837158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.837320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.837476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.837623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.837793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.837942 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:25:33.838089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.838236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.838397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.838623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.838784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.838932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.839105 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.839348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.839520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.839520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.840061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.840240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.840468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.840647 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.840873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.841082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.841266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.841523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.841678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.841843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.841998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.842178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.842413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.842576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.842726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.842881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843490 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843644 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.843915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.844213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.844368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.844526 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.844680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.844835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.844992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.845177 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.845327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.845480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.845641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.845798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.845954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.846862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.847287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.847434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.847434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.847434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.847434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.848002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.848150 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.848303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.848549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.849540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.849705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.849884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.850171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.850334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.850513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.850735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.850904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.851162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.851315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.851470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.851731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.851899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852203 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.852747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.853490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.853649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.853815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.854090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.854090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.854429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.854592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.854777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.854929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.855077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.855359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.855519 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.855676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.855831 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.855978 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.856137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.856292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.856448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.856604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.856760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.856915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.857969 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.858129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.858291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.858439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.858586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.858732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.858967 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.859128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.859291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.859446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.859622 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.859869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.860030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.860276 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.860458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.860608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.860608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.860986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.861271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.861434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.861605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.861865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.862998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.863144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.863308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.863465 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.863614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.863779 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.864054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.864212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.864383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.864551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.864709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.864869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.865983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.866136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.866294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.866449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.866604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.866761 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.866929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867848 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.867997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.868153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.868309 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.868457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.868603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.868750 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.868917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.869185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.869339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.869498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.869646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.869801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.870063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.870220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.870461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.870620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.871172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.871473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.871638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.871806 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.872082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.872360 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.872531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.872690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.872872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.873124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.873280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.873427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.873575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.873735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.873885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.874160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.874316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.874472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.874628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.874785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.874934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.875088 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.875246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.875394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.875549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.875705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.875854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876316 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.876970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.877152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.877707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.877875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.878033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.878194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.878351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.878508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.878693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.879030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.879213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.879446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.879603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.879753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.879900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.880103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.880349 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.880594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.880756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.880907 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.881124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.881304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.881607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.881779 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.881936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.882108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.882359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.882524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.882674 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.882821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.882975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.883243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.883413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.883582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.883738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.883894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.884051 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.884873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.885062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.885230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.885379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.885527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.885681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.885830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.886058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.886216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.886376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.886676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.886865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.887971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.888120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.888267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.888420 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.888579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.888727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.888884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.889032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.889265 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.889439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.889661 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.889824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.889986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.890143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.890291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.890544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.890794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.890794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.891105 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.891260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.891415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.891722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.891881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.892040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.892187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.892354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.892594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.892749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.892908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.893101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.893273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.893495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.893654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.893811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.893959 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.894238 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.894402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.894551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.894698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.894698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.895079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.895079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.895389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.895544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.896929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897536 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.897936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898452 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.898974 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899107 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899856 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.899996 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.900125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.900261 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.900391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.900542 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.900775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.900975 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.901149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.901290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.901429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.901557 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.901818 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.901961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.902222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.902365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.902496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.902638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.902850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.902988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.903132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.903270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.903413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.903872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904335 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.904877 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.905619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.905767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.905905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906167 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.906968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.910170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.910315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.910315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.910575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.910714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.910714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.911177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912847 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.912978 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.913139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.913139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.913394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.913522 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.913905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.914996 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915744 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.915995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916776 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.916916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.917228 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.917354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.917480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.917617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.917617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918822 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.918952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919088 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919438 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.919979 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.920190 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.920333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.920476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.920614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.920750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.920750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.921104 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.921329 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.921476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.921606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.921606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.921857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.922888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.923792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.924998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.925164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.925164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.925164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.925620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.925763 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.925763 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.926787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.927303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.927431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.927431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.927675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.927802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.927802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.928927 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.929756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.930981 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.931122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.931353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.931353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.931675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.931813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.931813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932420 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932812 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.932947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.933481 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.933617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.933617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.933870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934803 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.934932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.935182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.935472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.935609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.935738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.935738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.935992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.936905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937621 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.937997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938657 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938793 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.938921 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.939844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940551 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940690 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940690 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.940690 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.941089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.941231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.941231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.941484 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.941774 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.941774 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.942917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.943217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.943349 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.943478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.943606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.943606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.943864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944996 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.944996 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.945276 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.945426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.945618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.945755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.945892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.946929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.947064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.947064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.947356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.948880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.949293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.949430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.949430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.949681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.949817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.949817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.950091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.950221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.950391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.950540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.950752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.950931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.951063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.951333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.951467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.951796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.951948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.952091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.952260 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.952493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.952722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.952879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.953624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.953781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.953912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.954046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.954182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.954573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.954771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.954919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955772 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.955772 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956146 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956673 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.956809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.957106 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.957243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.957466 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.957628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.957795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.958059 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.958858 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.959165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.959307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.959498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.959653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.959832 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.960096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.960242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.960464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.960594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.960818 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.960984 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.961138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.961432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.961572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.961821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.961962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.962090 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.962968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963350 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963514 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.963989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.964155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.964320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.964522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.964648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.964857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.965021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.965192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.965367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.965503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.965697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.965830 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966673 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.966988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.967091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.967301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.967413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.967613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.967716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.967925 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.968280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.968383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.968592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.968693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.968919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.969093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.969287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.969447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.969650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.969785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.969935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.970099 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.970273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.970411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.970607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.970722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.971983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.972099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.972296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.972414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.972609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.972717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.972940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.973066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.973258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.973362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.973565 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.973657 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.974426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.974540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.974741 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.974847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.975120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.975220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.975346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.975439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.975675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.975884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976713 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.976924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977261 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.977991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.978212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.978313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.978523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.978615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.978833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.978934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.979143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.979235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.979460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.979552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.979777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.979880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.980093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.980182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.980401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.980500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.980717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.980814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.981142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.981259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.981468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.981567 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.981784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.981884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.982093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.982191 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.982412 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.982501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.982735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.982832 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.983049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.983304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.983398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.983630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.983739 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.983951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984050 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984268 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.984997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.985239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.985347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.985565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.985734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.985898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.986166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.986272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987277 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987510 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987651 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.987878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988096 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988632 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.988940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.989095 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.989279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.989389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.989612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.989701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.989918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990005 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990629 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.990934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.991147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.991286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.991458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.991577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.991763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.991880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.992984 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.993119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.993347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.993691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.994006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.994423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.994596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.994683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.994940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.995036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.995239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.995334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.995568 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.995678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.996399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.996523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.996623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.996718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.996805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.996961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.997152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.997317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.997429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.997733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.997859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998188 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998360 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.998985 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.999209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.999313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.999538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.999637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.999869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:33.999961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.000229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.000337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.000546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.000646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.000865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.000969 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.001210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.001325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.001524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.001628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.001851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.001963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.002163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.002274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.002475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.002577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.002784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.002887 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.003096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.003188 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.003482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.003598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.003721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.004037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.004223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.004392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.004485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.004707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.004797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.005063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.005164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.005403 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.005506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.005727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.005843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006030 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006360 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.006984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.007086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.007305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.007407 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.007623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.007734 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.007935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.008043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.008243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.008401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.008547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.008729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.008882 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.009073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.009230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:25:34.009410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.009558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.009854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.010187 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.010499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.010811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.011121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.011440 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.011749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.012056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.012368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.012677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.012995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.013327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.013643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.013956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.014270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.014578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.014890 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.015239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.015566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.015878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.016184 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.016507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.016817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.017166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.017486 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.017801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.018156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.018478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.019020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.019359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.019686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.020023 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.020358 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.021227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.021540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.021851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.022178 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.022493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.022808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.023123 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.023442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.023755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.024073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.024384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.024726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.025109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.025425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.025739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.026054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.026444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.026785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.027157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.027506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.027902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.028155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.028508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.028860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.029198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.029512 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.029867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.030243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.030596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.030929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.031318 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.031553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.032066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.032387 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.032711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.033078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.033424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.033792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.034119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.034437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.034764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.035142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.035544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.035863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.036199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.037320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.037638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.037953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.038266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.038583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.038910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.039227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.039537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.039892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.040276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.040613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.040924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.041299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.041723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.042071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.042380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.042714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.043023 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.043337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.043693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.044003 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.044351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.044662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.044971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.045308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.045622 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.045926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.046264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.046601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.046920 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.047274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.047593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.047921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.048231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.048559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.048888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.049255 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.049575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.049914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.050300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.050669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.050986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.051303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.051616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.051956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.052357 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.052723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.053106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.053453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.053775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.054100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.054418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.054829 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.055158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.055473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.055792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.056104 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.056539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.056877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.057222 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.057540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.057860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.058180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.058498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.058829 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.059159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.059473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.059802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.060132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.060485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.060801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.061181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.061513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.061831 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.062142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.062448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:25:34.062694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:25:34.072032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Registered counter for database nova_api Aug 30 04:25:34.092746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.099785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.127118 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Registered counter for database nova_api Aug 30 04:25:34.148407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.155050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.157881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.context [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b898ea9-960d-4dcf-9a7e-e7ae17af48ca(cell1) {{(pid=120716) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:25:34.162486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.162966 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.164554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.165310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.165759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.167732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.169764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Registered counter for database nova_cell0 Aug 30 04:25:34.173802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Registered counter for database nova_cell1 Aug 30 04:25:34.181390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.183084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.189407 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.190697 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.212929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.context [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b898ea9-960d-4dcf-9a7e-e7ae17af48ca(cell1) {{(pid=120715) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:25:34.216973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.217475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.219081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.219814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.220267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.222284 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.224619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Registered counter for database nova_cell0 Aug 30 04:25:34.228694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Registered counter for database nova_cell1 Aug 30 04:25:34.236122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.238316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.243745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.246909 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.342593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Registered counter for database nova_cell0 Aug 30 04:25:34.353226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.360629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.408743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Registered counter for database nova_cell0 Aug 30 04:25:34.415587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:25:34.420870 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:25:34.679931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:25:34.687090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:25:34.742603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:25:34.750194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:25:35.032824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:25:35.040078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-1d808552-3dc7-43a4-a355-990c5b1b484d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:25:35.045598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55802f8c49c0 pid: 120716 (default app) Aug 30 04:25:35.099559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:25:35.105882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-f053fc3c-b437-46ba-8af7-5ca2421fec36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:25:35.111566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55802f8c49c0 pid: 120715 (default app) Aug 30 04:26:10.113923 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:10.114727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:10.116632 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:10.117584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.435536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-06fbbd58-ab8e-4ec6-b59f-950e084ae650 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Action: 'create', calling method: .version_select at 0x7fcda908ce50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-580390583", "metadata": {"Type": "work"}}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-06fbbd58-ab8e-4ec6-b59f-950e084ae650 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Request method failure captured: Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 121 Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFiEK1I0uZGMEN-GrwWfPP6_N-QlRWf1yI_ZYUzmqgEuzV-Pjqjr43wbMtFmV_o5mHDbzaLLx2Nbm6px9nGym-OEYfQ2Qv1f2qFiPsVpA39Ee_7VnC7EJl8wN-laor7dU8Ydht5gaYf-zQWHajaoSabKKrGml5UA3owg-JIRh-axq0 Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:26:11.442624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b1363dbf0d3d4afe8d1b407483d3c6fe"}]}] Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 37df071b935f4a51b81e5130d9c44e1f Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-580390583", "metadata": {"Type": "work"}}} Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: Aug 30 04:26:11.444268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-580390583', 'metadata': {'Type': 'work'}}}} Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:11.445257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:11.446833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:11.448149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:26:11.448149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.449111 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-06fbbd58-ab8e-4ec6-b59f-950e084ae650 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:11.450247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-06fbbd58-ab8e-4ec6-b59f-950e084ae650 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.355415 Aug 30 04:26:11.453076 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:11.465655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.466504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.467276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.468458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.742001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5c3ec2a4-02b0-4c64-959f-f35e5ebbafe4 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Action: 'create', calling method: .version_select at 0x7fcda907eaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-547198292", "metadata": {"Type": "work"}}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5c3ec2a4-02b0-4c64-959f-f35e5ebbafe4 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Request method failure captured: Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 119 Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFiEK1I0uZGMEN-GrwWfPP6_N-QlRWf1yI_ZYUzmqgEuzV-Pjqjr43wbMtFmV_o5mHDbzaLLx2Nbm6px9nGym-OEYfQ2Qv1f2qFiPsVpA39Ee_7VnC7EJl8wN-laor7dU8Ydht5gaYf-zQWHajaoSabKKrGml5UA3owg-JIRh-axq0 Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:26:11.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b1363dbf0d3d4afe8d1b407483d3c6fe"}]}] Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 37df071b935f4a51b81e5130d9c44e1f Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-547198292", "metadata": {"Type": "work"}}} Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: Aug 30 04:26:11.750806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-547198292', 'metadata': {'Type': 'work'}}}} Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi '0' Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:11.751721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:11.753199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:11.754299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:26:11.754299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.754299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5c3ec2a4-02b0-4c64-959f-f35e5ebbafe4 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:11.754299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5c3ec2a4-02b0-4c64-959f-f35e5ebbafe4 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.291049 Aug 30 04:26:11.754299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 1/2] 10.222.0.85 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:11.762384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c57a447d-f403-4147-b457-3ceb2d217771 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Action: 'create', calling method: .version_select at 0x7fcda90445e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-249656049", "metadata": {"Type": "work"}}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c57a447d-f403-4147-b457-3ceb2d217771 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Request method failure captured: Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 118 Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFiEK1I0uZGMEN-GrwWfPP6_N-QlRWf1yI_ZYUzmqgEuzV-Pjqjr43wbMtFmV_o5mHDbzaLLx2Nbm6px9nGym-OEYfQ2Qv1f2qFiPsVpA39Ee_7VnC7EJl8wN-laor7dU8Ydht5gaYf-zQWHajaoSabKKrGml5UA3owg-JIRh-axq0 Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:26:11.767232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b1363dbf0d3d4afe8d1b407483d3c6fe"}]}] Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 37df071b935f4a51b81e5130d9c44e1f Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-249656049", "metadata": {"Type": "work"}}} Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: Aug 30 04:26:11.768701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-249656049', 'metadata': {'Type': 'work'}}}} Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi '' Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:11.769859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:11.771342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:11.772579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:26:11.772579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:26:11.773590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c57a447d-f403-4147-b457-3ceb2d217771 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:11.774619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c57a447d-f403-4147-b457-3ceb2d217771 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017723 Aug 30 04:26:11.776046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 2/3] 10.222.0.85 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:26:11.788504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7db19910-4c52-437e-b8f3-b750796f4470 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Calling method '.version_select at 0x7fcda9899310>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:12.335792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e4ee3ded-1c42-4990-bd97-55310c381c97 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Action: 'create', calling method: .version_select at 0x7fcda8f419d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1982436297", "metadata": {"Type": "work"}}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:14.350139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-7db19910-4c52-437e-b8f3-b750796f4470 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] HTTP exception thrown: Volume tempest-invalid-990765562 could not be found. Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7db19910-4c52-437e-b8f3-b750796f4470 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Request method failure captured: Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-990765562 HTTP/1.1 Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFiEK1I0uZGMEN-GrwWfPP6_N-QlRWf1yI_ZYUzmqgEuzV-Pjqjr43wbMtFmV_o5mHDbzaLLx2Nbm6px9nGym-OEYfQ2Qv1f2qFiPsVpA39Ee_7VnC7EJl8wN-laor7dU8Ydht5gaYf-zQWHajaoSabKKrGml5UA3owg-JIRh-axq0 Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:26:14.355706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b1363dbf0d3d4afe8d1b407483d3c6fe"}]}] Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 37df071b935f4a51b81e5130d9c44e1f Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Volume tempest-invalid-990765562 could not be found. Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'tempest-invalid-990765562'} Aug 30 04:26:14.357139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-990765562 could not be found. (HTTP 404) (Request-ID: req-d0f5386a-544b-4457-9bff-db77779aca0c) Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.358106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:14.359270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-990765562 could not be found. Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:14.360430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-990765562 could not be found. Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-990765562 could not be found. Aug 30 04:26:14.364181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.366762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7db19910-4c52-437e-b8f3-b750796f4470 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Returning 404 to user: Volume tempest-invalid-990765562 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:14.368020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7db19910-4c52-437e-b8f3-b750796f4470 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-990765562" status: 404 len: 98 microversion: 2.1 time: 2.586188 Aug 30 04:26:14.376242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 2/4] 10.222.0.85 () {58 vars in 1215 bytes} [Tue Aug 30 04:26:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-990765562 => generated 98 bytes in 2595 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:26:14.398986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1f0737a7-9ef4-4dfe-a1f3-0a2f6c1d6032 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014690 Aug 30 04:26:14.408046 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 3/5] 10.222.0.85 () {58 vars in 1140 bytes} [Tue Aug 30 04:26:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:26:14.421213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0749a963-ec6a-4244-be67-0e31e1cc7d68 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010964 Aug 30 04:26:14.421709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 4/6] 10.222.0.85 () {58 vars in 1137 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:26:14.431133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-41b856c6-c390-437a-a1d8-a1692f8bbe41 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Calling method '.version_select at 0x7fcda8e93700>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-41b856c6-c390-437a-a1d8-a1692f8bbe41 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] HTTP exception thrown: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-41b856c6-c390-437a-a1d8-a1692f8bbe41 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Request method failure captured: Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/os-volumes/0b55f91e-1f9a-4269-bc2d-ac1a5311994a HTTP/1.1 Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFiEK1I0uZGMEN-GrwWfPP6_N-QlRWf1yI_ZYUzmqgEuzV-Pjqjr43wbMtFmV_o5mHDbzaLLx2Nbm6px9nGym-OEYfQ2Qv1f2qFiPsVpA39Ee_7VnC7EJl8wN-laor7dU8Ydht5gaYf-zQWHajaoSabKKrGml5UA3owg-JIRh-axq0 Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:26:14.853507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b1363dbf0d3d4afe8d1b407483d3c6fe"}]}] Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 37df071b935f4a51b81e5130d9c44e1f Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '0b55f91e-1f9a-4269-bc2d-ac1a5311994a'} Aug 30 04:26:14.866410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. (HTTP 404) (Request-ID: req-d9529850-455e-4840-af71-89157f570cdb) Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.881985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:14.885580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:26:14.887681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-41b856c6-c390-437a-a1d8-a1692f8bbe41 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Returning 404 to user: Volume 0b55f91e-1f9a-4269-bc2d-ac1a5311994a could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-41b856c6-c390-437a-a1d8-a1692f8bbe41 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/0b55f91e-1f9a-4269-bc2d-ac1a5311994a" status: 404 len: 109 microversion: 2.1 time: 0.391968 Aug 30 04:26:14.891275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 5/7] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:26:14 2022] DELETE /compute/v2.1/os-volumes/0b55f91e-1f9a-4269-bc2d-ac1a5311994a => generated 109 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:14.896365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-842aa283-5904-4054-8a3f-c2b61ae8e0c0 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Calling method '.version_select at 0x7fcda8ea21f0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.913713 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e4ee3ded-1c42-4990-bd97-55310c381c97 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.958536 Aug 30 04:26:14.925263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 3/8] 10.222.0.85 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2967 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 04:26:14.935326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2a4af82b-6c76-4434-a7e8-b50364efee74 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Calling method '.version_select at 0x7fcda8ece3a0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.997700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-842aa283-5904-4054-8a3f-c2b61ae8e0c0 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] HTTP exception thrown: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-842aa283-5904-4054-8a3f-c2b61ae8e0c0 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Request method failure captured: Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/os-volumes/304abdee-79a6-41cb-8356-ad32195bf447 HTTP/1.1 Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFiEK1I0uZGMEN-GrwWfPP6_N-QlRWf1yI_ZYUzmqgEuzV-Pjqjr43wbMtFmV_o5mHDbzaLLx2Nbm6px9nGym-OEYfQ2Qv1f2qFiPsVpA39Ee_7VnC7EJl8wN-laor7dU8Ydht5gaYf-zQWHajaoSabKKrGml5UA3owg-JIRh-axq0 Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:26:14.999918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b1363dbf0d3d4afe8d1b407483d3c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b1363dbf0d3d4afe8d1b407483d3c6fe"}]}] Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: b1363dbf0d3d4afe8d1b407483d3c6fe Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-1971590247 Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 37df071b935f4a51b81e5130d9c44e1f Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-1971590247-project Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '304abdee-79a6-41cb-8356-ad32195bf447'} Aug 30 04:26:15.000935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. (HTTP 404) (Request-ID: req-be45df10-eccb-4523-a78c-5b30e68fd520) Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:15.001922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:15.002790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:26:15.003698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. Aug 30 04:26:15.004656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.007652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-842aa283-5904-4054-8a3f-c2b61ae8e0c0 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] Returning 404 to user: Volume 304abdee-79a6-41cb-8356-ad32195bf447 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:15.009069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-842aa283-5904-4054-8a3f-c2b61ae8e0c0 tempest-VolumesNegativeTest-1971590247 tempest-VolumesNegativeTest-1971590247-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/304abdee-79a6-41cb-8356-ad32195bf447" status: 404 len: 109 microversion: 2.1 time: 0.183178 Aug 30 04:26:15.009069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 6/9] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/os-volumes/304abdee-79a6-41cb-8356-ad32195bf447 => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:26:15.134027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2a4af82b-6c76-4434-a7e8-b50364efee74 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81" status: 200 len: 353 microversion: 2.1 time: 0.208312 Aug 30 04:26:15.135102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 4/10] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:16.122742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2eaff21a-4c51-46e9-919c-b0a2644f2190 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8e933a0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.154730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a479c74f-bde2-4d67-be35-f05eb34265a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Calling method '.version_select at 0x7fcda8ecea60>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.227564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2eaff21a-4c51-46e9-919c-b0a2644f2190 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/b2e6957a-e7c2-41c4-a3b6-8e40617adbd3" status: 200 len: 351 microversion: 2.1 time: 0.115957 Aug 30 04:26:16.243606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a479c74f-bde2-4d67-be35-f05eb34265a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81" status: 200 len: 354 microversion: 2.1 time: 0.097942 Aug 30 04:26:16.245712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 5/11] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:16.254130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 7/12] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/os-volumes/b2e6957a-e7c2-41c4-a3b6-8e40617adbd3 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:16.260188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-94c64039-ba5b-4d60-884c-1f02ac8b3733 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Calling method '.version_select at 0x7fcda8ee3160>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.388254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-94c64039-ba5b-4d60-884c-1f02ac8b3733 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81" status: 200 len: 354 microversion: 2.1 time: 0.132794 Aug 30 04:26:16.389300 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 6/13] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:16.425824 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2a5138f5-b668-4d56-b477-33c2478de234 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Calling method '.version_select at 0x7fcda8ea25e0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.578602 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2a5138f5-b668-4d56-b477-33c2478de234 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81" status: 202 len: 0 microversion: 2.1 time: 0.170958 Aug 30 04:26:16.579802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 8/14] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:26:16 2022] DELETE /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:16.590696 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-88f3bbc2-3f4c-4699-9369-45992e073ef4 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Calling method '.version_select at 0x7fcda8eced30>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.687473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-88f3bbc2-3f4c-4699-9369-45992e073ef4 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81" status: 200 len: 353 microversion: 2.1 time: 0.101110 Aug 30 04:26:16.688500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 7/15] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:17.701649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f61b7390-1f3d-4e65-8d96-469dd58020a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Calling method '.version_select at 0x7fcda8ea2820>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:17.772912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-f61b7390-1f3d-4e65-8d96-469dd58020a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] HTTP exception thrown: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f61b7390-1f3d-4e65-8d96-469dd58020a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Request method failure captured: Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 HTTP/1.1 Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFjrYdXrSIv4AR-up4Ij-ZOks8o2ukSDupRPWTKfBWJeKAMWI3gfjIPxpzxzvDXatWD0_Nuz1z7vkA6m5QnM6cFJnNYSJC4cadIx34Ty2y5_4CfOuPPWaHzhNqgEXV6W54ftxqLgZA-nXqnU4hoEi0TzH7TgAqaDOtV_LWWvuNpa3o Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: e35dc7910f7448f1b0646bb291261be0 Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesGetTestJSON-367846494 Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:26:17.775074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e35dc7910f7448f1b0646bb291261be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e35dc7910f7448f1b0646bb291261be0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e35dc7910f7448f1b0646bb291261be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e35dc7910f7448f1b0646bb291261be0"}]}] Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesGetTestJSON-367846494 Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e35dc7910f7448f1b0646bb291261be0 Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesGetTestJSON-367846494 Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesGetTestJSON-367846494-project Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: e7284a7792a04e9493c54eae58ca89a6 Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesGetTestJSON-367846494-project Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'c62a6b33-c501-4995-a91e-adb1e9a11a81'} Aug 30 04:26:17.776360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. (HTTP 404) (Request-ID: req-ebb8eab2-50fe-4985-a0e4-3cf1dff3d482) Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:17.777229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:17.778335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:26:17.779377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. Aug 30 04:26:17.780593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.782071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f61b7390-1f3d-4e65-8d96-469dd58020a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] Returning 404 to user: Volume c62a6b33-c501-4995-a91e-adb1e9a11a81 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:17.783086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f61b7390-1f3d-4e65-8d96-469dd58020a1 tempest-VolumesGetTestJSON-367846494 tempest-VolumesGetTestJSON-367846494-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81" status: 404 len: 109 microversion: 2.1 time: 0.085409 Aug 30 04:26:17.784261 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 9/16] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:17 2022] GET /compute/v2.1/os-volumes/c62a6b33-c501-4995-a91e-adb1e9a11a81 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:18.178357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7a166b21-1836-4b2f-8401-f80c68c8920d tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ece670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.293571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7a166b21-1836-4b2f-8401-f80c68c8920d tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/b93bbbf2-fcbc-49a8-81a9-eab62abf3b6d" status: 200 len: 351 microversion: 2.1 time: 0.120701 Aug 30 04:26:18.297226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 8/17] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:18 2022] GET /compute/v2.1/os-volumes/b93bbbf2-fcbc-49a8-81a9-eab62abf3b6d => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:20.076707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a0a7c185-15c5-4c35-9978-ba3b474f9c9f tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8e93670>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.231234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a0a7c185-15c5-4c35-9978-ba3b474f9c9f tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1e0ba3a5-5e35-490e-9dfb-0a6e202f8c8a" status: 200 len: 350 microversion: 2.1 time: 0.158617 Aug 30 04:26:20.231648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 10/18] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/os-volumes/1e0ba3a5-5e35-490e-9dfb-0a6e202f8c8a => generated 350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:20.244689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ea46d30a-f57d-4389-8aed-9a4c9f81fbb4 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ee3670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.429716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ea46d30a-f57d-4389-8aed-9a4c9f81fbb4 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.188910 Aug 30 04:26:20.430348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 9/19] 10.222.0.85 () {58 vars in 1134 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:20.448801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9cd1aee0-47d0-4f80-a9cb-3127dcf9e8fc tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ea2c10>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.589440 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9cd1aee0-47d0-4f80-a9cb-3127dcf9e8fc tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.148664 Aug 30 04:26:20.590807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 11/20] 10.222.0.85 () {58 vars in 1149 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:20.604333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6da27126-d90d-43d0-be39-ea5f5542567f tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ee3af0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.792700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6da27126-d90d-43d0-be39-ea5f5542567f tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.192626 Aug 30 04:26:20.793580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 10/21] 10.222.0.85 () {58 vars in 1134 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:20.808249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fba55a1d-65a0-4fa4-a191-5e176c3f3f76 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8e93160>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.981532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fba55a1d-65a0-4fa4-a191-5e176c3f3f76 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.178422 Aug 30 04:26:20.991044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 12/22] 10.222.0.85 () {58 vars in 1167 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:21.006814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-74475746-8437-447e-a60a-8fda69e2a7d2 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ece430>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:21.261614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-74475746-8437-447e-a60a-8fda69e2a7d2 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.268404 Aug 30 04:26:21.262198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 11/23] 10.222.0.85 () {58 vars in 1170 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:21.277007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8557077c-e47f-44e7-a83e-ff5e4da83cc5 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ea2ca0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:21.595312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8557077c-e47f-44e7-a83e-ff5e4da83cc5 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.322400 Aug 30 04:26:21.596127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 13/24] 10.222.0.85 () {58 vars in 1155 bytes} [Tue Aug 30 04:26:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:21.609497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5857c332-8f65-4bd7-9416-b17cb8a8f8f0 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ece820>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:21.868356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5857c332-8f65-4bd7-9416-b17cb8a8f8f0 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.262992 Aug 30 04:26:21.868924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 12/25] 10.222.0.85 () {58 vars in 1188 bytes} [Tue Aug 30 04:26:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:21.882354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a4e6bda6-36c6-44e9-8d4b-d7b933005028 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] Calling method '.version_select at 0x7fcda8ea7700>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.107997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a4e6bda6-36c6-44e9-8d4b-d7b933005028 tempest-VolumesTestJSON-1948239449 tempest-VolumesTestJSON-1948239449-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.229792 Aug 30 04:26:22.109103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 14/26] 10.222.0.85 () {58 vars in 1155 bytes} [Tue Aug 30 04:26:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:22.682574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-514406434", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:22.913496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] validate_networks() for [('661607d2-cb41-40c5-ac13-3334a7f66c5e', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:26:23.174298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f0ea9af8-3c4e-4c4d-912e-b65c0cc8d880 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: .version_select at 0x7fcda8ea2dc0>, body: {"keypair": {"name": "tempest-keypair-1654006362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+7MnjnsDQMFkUPkUVgK/4Iy8e3vY5MkZ1327rB1cBys0l0onniGhDBq8YY4Oa/J3KBlsckbn6JO+/CXZK4wzs7pwyXj34PQNZArGvYQpWogdQDHCH7Dku6oR6pcI79lw=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:23.310078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-f0ea9af8-3c4e-4c4d-912e-b65c0cc8d880 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for project d7deffddf9934a028bfdb0b1c965c618. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:23.330838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-f0ea9af8-3c4e-4c4d-912e-b65c0cc8d880 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for user 8ef7a83a87d44fc0a5647cb60057c036 and project d7deffddf9934a028bfdb0b1c965c618. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:23.437119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f0ea9af8-3c4e-4c4d-912e-b65c0cc8d880 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.695508 Aug 30 04:26:23.439453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 15/27] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:26:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:25.291246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:25.292289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:25.293015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:25.293602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:25.294283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:25.335942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.336432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.340278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.341495 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.346313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.346955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.451778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for project edc09fe630034be4b292562e2de6e3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:25.491820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for user cbf574ed57d446bc8fabe7813e64e92c and project edc09fe630034be4b292562e2de6e3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:25.548173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:25.561362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:25.818560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-86fe1b58-293e-4e61-aa1e-72c155ae2ff8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.644836 Aug 30 04:26:25.820956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 13/28] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:25.835416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3d01293e-0954-43cc-b337-16d2aaf3bc96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.836747 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3d01293e-0954-43cc-b337-16d2aaf3bc96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:26.086014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3d01293e-0954-43cc-b337-16d2aaf3bc96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.124052 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3d01293e-0954-43cc-b337-16d2aaf3bc96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1221 microversion: 2.1 time: 0.294749 Aug 30 04:26:26.126300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 16/29] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:26.405123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-940411370", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:26.596843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] validate_networks() for [('661607d2-cb41-40c5-ac13-3334a7f66c5e', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:26:27.755953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:27.757274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:27.757758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:27.758494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:27.759146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:27.777521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.778341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.779316 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.780423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.781151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.781947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.807990 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for project edc09fe630034be4b292562e2de6e3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:27.812802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for user cbf574ed57d446bc8fabe7813e64e92c and project edc09fe630034be4b292562e2de6e3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:27.827885 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:27.830207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:27.932668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6069550f-6419-4279-8aa8-72d9a30eebd8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.535286 Aug 30 04:26:27.937885 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 14/30] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:27.948361 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-06f144be-77f4-4644-8037-c495c7f09577 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.949584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-06f144be-77f4-4644-8037-c495c7f09577 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:28.267902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06f144be-77f4-4644-8037-c495c7f09577 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:28.286612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-06f144be-77f4-4644-8037-c495c7f09577 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1221 microversion: 2.1 time: 0.342438 Aug 30 04:26:28.305484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 17/31] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1221 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:29.309801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0cd5abfe-f6c5-45df-90fb-6a807f5113e7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.311504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0cd5abfe-f6c5-45df-90fb-6a807f5113e7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.655950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0cd5abfe-f6c5-45df-90fb-6a807f5113e7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:29.719751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0cd5abfe-f6c5-45df-90fb-6a807f5113e7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1221 microversion: 2.1 time: 0.406335 Aug 30 04:26:29.725723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 15/32] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1221 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:30.614158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-292430034", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "networks": [{"uuid": "2ae43651-2c59-4902-9fbc-2b9d1dde6e96"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:30.752504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:30.753516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:30.796489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:30.796983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:30.797442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:30.812601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:30.818685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:30.821891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:30.883331 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] validate_networks() for [('2ae43651-2c59-4902-9fbc-2b9d1dde6e96', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:26:31.359201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:31.394793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5b7e34af-0f7c-456a-b20b-7579c8a35a48 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1273 microversion: 2.1 time: 0.645805 Aug 30 04:26:31.399704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 16/33] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:30 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1273 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:32.419834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:32.421214 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:32.440697 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.442381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.446204 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.446958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.447427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.447862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.834648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:32.865130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-24c19c52-e593-4d0d-8145-f2b81023e4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1279 microversion: 2.1 time: 0.434333 Aug 30 04:26:32.870421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 17/34] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:32 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1279 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:32.965814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1480143557", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fc2da6b-035c-428c-8a36-2438f46094fd"}], "security_groups": [{"name": "tempest-securitygroup--983349526"}], "key_name": "tempest-keypair-1654006362", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:33.856518 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] validate_networks() for [('7fc2da6b-035c-428c-8a36-2438f46094fd', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:26:36.205951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:36.206968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:36.207854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:36.208396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:36.208805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:36.224346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.227152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.228001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.231468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.232687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.235004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.298079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Getting quotas for project 959853ec613f47819ed2883c8539b24e. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:36.315711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Getting quotas for user 298b05a8580946f4ab2ed66f0b9a3c2b and project 959853ec613f47819ed2883c8539b24e. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:36.377419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:36.380456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:36.693019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-de7ba102-d649-49bd-99e7-0bb0f3b58ebe tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.409669 Aug 30 04:26:36.705006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 18/35] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 6423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:36.723552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:36.725377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:36.747343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.748024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.748466 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.749544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.750598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.751035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:37.085719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:37.121745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8d18b1ba-3027-4ab1-bec3-53655d8f7b2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1279 microversion: 2.1 time: 0.405967 Aug 30 04:26:37.125099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 19/36] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:36 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1279 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:37.127328 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-80cbd04c-4222-4d72-ae7f-a6bb36436947 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:37.132380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-80cbd04c-4222-4d72-ae7f-a6bb36436947 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:37.460678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-80cbd04c-4222-4d72-ae7f-a6bb36436947 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:37.482292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-80cbd04c-4222-4d72-ae7f-a6bb36436947 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1214 microversion: 2.1 time: 0.358382 Aug 30 04:26:37.482790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 20/37] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:37 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:37.755925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:37.757242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:37.757909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:37.758618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:37.759188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:37.808168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:37.814377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:37.818519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:37.820691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:37.823370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:37.826631 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:37.829380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:37.888066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for project d7deffddf9934a028bfdb0b1c965c618. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:37.895851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for user 8ef7a83a87d44fc0a5647cb60057c036 and project d7deffddf9934a028bfdb0b1c965c618. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:37.914177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:37.922950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:38.037309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9a04c954-6735-482c-b161-610df0502781 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.074332 Aug 30 04:26:38.041265 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 18/38] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 5084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:26:38.058853 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9b27296f-9084-486a-8b7d-ef99685647f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:38.059468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9b27296f-9084-486a-8b7d-ef99685647f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:38.143452 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:38.144419 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:38.160271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.160933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.161401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.162163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.162715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.163201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.449639 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9b27296f-9084-486a-8b7d-ef99685647f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:38.465751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9b27296f-9084-486a-8b7d-ef99685647f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1238 microversion: 2.1 time: 0.402800 Aug 30 04:26:38.466424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 21/39] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:38 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1238 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:38.505994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:38.506630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:38.525590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.533870 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.546684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.549322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.550758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.552136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.747388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:38.769545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-835b103b-183b-4069-ad05-0671885762a6 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1210 microversion: 2.1 time: 0.264690 Aug 30 04:26:38.773114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 22/40] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:38 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1210 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:39.089466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:39.107906 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dd5a6869-c7cf-4150-bea5-f0ff648e0176 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.968639 Aug 30 04:26:39.130861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 19/41] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:38 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:39.487807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:39.489232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:39.500767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.501559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.502159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.505523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.506481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.509343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.739674 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:39.748855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-55f1b135-d380-4e5e-b6c9-6260c22a6703 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1242 microversion: 2.1 time: 0.264719 Aug 30 04:26:39.751090 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 23/42] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:39 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1242 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:39.793832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:39.794733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:39.802846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.807317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.810850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.811809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.814819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.819032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.988367 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:40.003904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-223a8be5-980e-404c-980e-45e033ce7a85 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1210 microversion: 2.1 time: 0.211052 Aug 30 04:26:40.004911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 20/43] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:39 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1210 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:40.129660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.130545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.150317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.152502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.153743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.155392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.157536 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.158878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.772588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.774018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.783803 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.792398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.794320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.796489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.799272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.800384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.030570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.045972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2ed0e7ac-c04c-4cfb-92ab-663f71ded8d3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1242 microversion: 2.1 time: 0.275920 Aug 30 04:26:41.048352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 21/44] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:40 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1242 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:41.152500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.166332 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ad8953e3-f083-4261-b9ba-839db7954463 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 1.040663 Aug 30 04:26:41.168537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 24/45] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:40 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:41.193677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:41.194303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:41.210404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.213336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.219652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.220773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.222519 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.225173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.425715 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.435082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f094234f-b864-469b-adf9-23fb316b8bce tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1210 microversion: 2.1 time: 0.264536 Aug 30 04:26:41.440599 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 25/46] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:41 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1210 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:41.530586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f359fb4c-9bdc-4898-81b0-26ea768f4444", "tag": "05e9029b-f746-406c-93bb-e93c4ab2ecb9"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:41.574845 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.579766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.580546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.631962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Creating event network-changed:05e9029b-f746-406c-93bb-e93c4ab2ecb9 for instance f359fb4c-9bdc-4898-81b0-26ea768f4444 on hv-cinder-85426 Aug 30 04:26:41.633586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:26:41.634299 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b92e2bcf-f439-45f9-af5f-980ae2f53c4b req-514ff508-69e9-49dd-8b8b-f67baf3979f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:26:41.636872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.638779 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.639947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.641274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.641924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.642583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.656715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.compute.rpcapi [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:26:41.658182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] Releasing lock "compute-rpcapi-router" {{(pid=120716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:26:41.693283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2731e96d-f444-4277-a17d-d0af862efb63 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.640988 Aug 30 04:26:41.695260 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 22/47] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:42.015623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a97c5a-7835-4178-8975-f4ce0f14bcda", "tag": "2fdbdf3d-c596-40b2-9e74-2020a17a72ed"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:42.041004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.046437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.053929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.074033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:42.074899 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:42.101636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.102411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.103067 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.104001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.106047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.107337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.129547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Creating event network-changed:2fdbdf3d-c596-40b2-9e74-2020a17a72ed for instance b6a97c5a-7835-4178-8975-f4ce0f14bcda on hv-cinder-85426 Aug 30 04:26:42.130092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:26:42.130470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48024d4b-fbd7-4e33-b235-97b178ec8e0d req-57dc05e9-0847-49d8-a6fd-82d5ecc5cd1c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:26:42.131534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.131991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.132416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.133155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.133598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.142097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.180799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.compute.rpcapi [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:26:42.183004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] Releasing lock "compute-rpcapi-router" {{(pid=120715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:26:42.206757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa2074fd-0997-4db6-b9cd-c05b8b2946dd None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279805 Aug 30 04:26:42.207857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 26/48] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:42.216626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:42.217641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:42.230516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:42.234451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.234954 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.235387 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.236226 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.236676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.237703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.240729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f3e20069-6bbd-449d-8588-3e6ebb20effb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1242 microversion: 2.1 time: 0.171578 Aug 30 04:26:42.258133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 23/49] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:42 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1242 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:42.465002 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:42.465650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:42.467579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:42.473979 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.474910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.475640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.476843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.477585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.479028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.482894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0f470302-6358-4f88-8258-a2bbfad97f6c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.269990 Aug 30 04:26:42.484724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 27/50] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:42 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:42.598090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:42.607143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fbde8f57-e2cf-4bd2-9cba-16751dcdf968 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1210 microversion: 2.1 time: 0.145896 Aug 30 04:26:42.608973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 24/51] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:42 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1210 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:43.273159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:43.274805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:43.287820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.289667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.291381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.293009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.294754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.295716 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.450971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:43.461512 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e68afbf1-0f21-4261-b8bd-03a9c565fc8b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1242 microversion: 2.1 time: 0.193148 Aug 30 04:26:43.475556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 28/52] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:43 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:43.509550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:43.510356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:43.525192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.526669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.532317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.536144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.536874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.537559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.631296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:43.632228 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:43.659210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.659805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.660385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.662778 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.664889 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.666172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.915250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:43.927538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-01e01e68-7ea8-4b35-960c-fffabc6b8d09 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1210 microversion: 2.1 time: 0.301558 Aug 30 04:26:43.929527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 29/53] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:43 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1210 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:43.974666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:43.984971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fe528514-9f6f-4785-9a01-622203ac50fd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.479725 Aug 30 04:26:43.986767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 25/54] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:43 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:44.482109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:44.483717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:44.498257 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.499401 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.500060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.501854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.505166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.505865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.731336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:44.738783 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-747ecdda-281c-423d-a91d-b08f25839043 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1234 microversion: 2.1 time: 0.260353 Aug 30 04:26:44.739832 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 30/55] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:44 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1234 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:44.956020 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:44.956020 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:44.960944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.960944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.963214 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.963689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.965102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.965853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.009433 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:45.010198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:45.017605 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:45.019549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:45.020074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.023161 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:45.023719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:45.024707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.062558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:45.071711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-085e4428-0f4b-4f5a-a762-f235248c9d31 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1266 microversion: 2.1 time: 0.125760 Aug 30 04:26:45.072524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 26/56] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:44 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:45.207970 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:45.216418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-baacdea3-c864-4156-8071-83ae9e427d39 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.210655 Aug 30 04:26:45.217011 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 31/57] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:45 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:45.761383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:45.763432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:45.771348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:45.772071 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:45.772742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.774152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:45.775386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:45.776004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.845233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:45.853615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-15f75d8f-926f-429d-ac7c-d4e4333e20c7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1234 microversion: 2.1 time: 0.096860 Aug 30 04:26:45.854400 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 27/58] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:45 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1234 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:46.094502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:46.095211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:46.101671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.102147 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.102608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.103406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.103855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.104270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.166062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:46.174278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-47358f86-2a29-4a82-bad3-de5fe2322e29 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1266 microversion: 2.1 time: 0.083938 Aug 30 04:26:46.174865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 32/59] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:46 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:46.238708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:46.239492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:46.245819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.246405 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.246975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.247747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.248245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.248765 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.385569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:46.397115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bae16af2-f2d9-4521-a717-0b28a5a091f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.163049 Aug 30 04:26:46.397698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 28/60] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:46 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:46.876362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:46.877414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:46.884498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.884991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.885449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.886143 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.886597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.887020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.954140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:46.961696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-479372d5-045c-4f3a-bb8d-19191df8b5be tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1234 microversion: 2.1 time: 0.089800 Aug 30 04:26:46.962267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 33/61] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:46 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:47.197492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:47.198279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:47.216839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.217819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.218679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.219603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.220555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.221163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.301874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:47.310580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-37a9e64e-ffbd-42ed-bb76-f980b3977ca4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1266 microversion: 2.1 time: 0.118109 Aug 30 04:26:47.311421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 29/62] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:47 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:47.417937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:47.418584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:47.425638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.426020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.426448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.427139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.427587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.428006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.755745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:47.768688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f5c970cf-8bb4-4116-91af-8472aed5270c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.354443 Aug 30 04:26:47.769696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 34/63] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:47 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:47.983431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:47.984046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:47.986037 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=20 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:47.992902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.993432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.993872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.998156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.998156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.998156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.120958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:48.131895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-779d5fff-3f19-4db6-8dd9-0288bb7ae854 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1290 microversion: 2.1 time: 0.152548 Aug 30 04:26:48.132469 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 30/64] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:47 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:48.334895 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.336285 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:48.346875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.349757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.350450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.351531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.354279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.354971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.453783 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=18 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:48.650595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:48.663184 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fb7c8dc4-b4f1-496a-9ee2-c57acec0f37a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1274 microversion: 2.1 time: 0.334142 Aug 30 04:26:48.664578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 35/65] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:48 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1274 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:48.796581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.797251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:48.809559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.814667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.815919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.818351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.825614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.826137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.158644 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:49.160141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:49.175685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:49.177337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:49.177795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.180010 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:49.180487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:49.180923 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.247147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.266603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-81f19124-db9d-4492-a4b2-af882a4ecb8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.470979 Aug 30 04:26:49.269558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 31/66] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:48 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:49.424308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.438811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-76217742-9efe-46e7-981b-908f25dd7763 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1308 microversion: 2.1 time: 0.284980 Aug 30 04:26:49.442075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 36/67] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:49 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:49.686669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:49.687343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:49.699131 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:49.699898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:49.700833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.702126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:49.705435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:49.706126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.291568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:50.292523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:50.300115 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.300612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.313819 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.313819 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.313819 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.314145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.360346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:50.415556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:50.417764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=99 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:50.424980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-871c66cc-853d-4004-8e2a-ef6fbe499218 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.741702 Aug 30 04:26:50.433005 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 32/68] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:49 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:50.465465 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:50.466482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:50.475261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:50.477311 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.478142 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.479801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.481158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.481952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.483187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.666317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:50.682366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:50.687821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d2192e17-39f6-4e00-b004-d8674ae49d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1296 microversion: 2.1 time: 0.228542 Aug 30 04:26:50.688707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 33/69] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:50 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1296 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:50.707344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e77fbaba-4c72-4af9-9c1f-5c86ac8eb8f2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.420146 Aug 30 04:26:50.708133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 37/70] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:50 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:51.451978 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:51.452652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:51.459431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.460062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.460565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.462422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.463004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.463521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.615648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:51.628109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ea3f829c-0802-40fa-bdbf-ff66873c26dd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.180503 Aug 30 04:26:51.641775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 34/71] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:51 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:51.714200 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:51.715427 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:51.721437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.721931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.722371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.723294 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.723833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.724266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.737211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:51.738104 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:51.747664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:51.749608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.750379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.751049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.751953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.753201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.754085 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.060084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.071035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1ef862ee-eafd-4074-a25b-624dcbbb8b62 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.360019 Aug 30 04:26:52.071729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 38/72] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:51 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:52.080238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.095013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0bcc28b1-d022-461f-9abc-0ce71f847454 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.366854 Aug 30 04:26:52.095599 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 35/73] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:51 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:52.651701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:52.652333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:52.654389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:52.655202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:52.661934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:52.662675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:52.663298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.664164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:52.664611 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:52.665032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.816288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.825026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-576220cd-17fd-4390-a10c-41567fe11e1e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.179021 Aug 30 04:26:52.825879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 39/74] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:52 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:53.097239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:53.097863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:53.104133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.104630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.105118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.106039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.106709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.107374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.123059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:53.124151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:53.136447 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.136941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.137402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.138446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.138899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.139484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.350742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:53.354902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:53.364048 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5d6cfe2c-4906-47a0-a3c7-5ec6dd1d8d86 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.272516 Aug 30 04:26:53.364939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 36/75] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:53 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:53.366077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3bb60a9d-2c40-4560-9d78-ee391140e8b4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.247044 Aug 30 04:26:53.366833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 40/76] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:53 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:53.845719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:53.847193 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:53.853383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.853878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.854312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.855006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.855584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.856213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.002771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.015271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77e24dbb-9d33-4828-97f2-f9ba00a6de1a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.173509 Aug 30 04:26:54.016365 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 37/77] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:53 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:54.388026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:54.389408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:54.394968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:54.395660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:54.397527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:54.398059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:54.398739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.399734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:54.400388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:54.401054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.406516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:54.407025 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:54.407447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.408148 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:54.408660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:54.411429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.745428 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.748215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.756705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ab3b3c11-0081-4f7d-af13-b03fbc9e32da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.372771 Aug 30 04:26:54.756892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5142c094-2b11-431b-a5c1-41093ead9892 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.371207 Aug 30 04:26:54.757838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 38/78] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:54 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:54.759540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 41/79] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:54 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:55.037349 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:55.038399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:55.046644 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.047415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.048063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.048993 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.049724 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.050356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.520800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:55.531623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89f776b0-c84b-4a09-a4a5-1edc1813f7fd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.499618 Aug 30 04:26:55.532374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 39/80] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:55 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:55.805848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:55.807077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:55.817249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:55.819833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:55.834765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.836020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.839229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.840681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.841353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.841963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.843211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.846887 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.847463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.848600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.849084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.854417 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.224374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.238139 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5543db03-ab72-4981-bd2b-9125f63a642b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.450063 Aug 30 04:26:56.238715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 40/81] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:55 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:56.395089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.406456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d0d9371a-d132-4184-8428-ff0ea73b04c7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.616893 Aug 30 04:26:56.407961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 42/82] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:55 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:56.553633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:56.554243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:56.561259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-385ccd6e-3a76-4cb9-985b-82ec83af8db6 req-d6eaf60e-582b-448b-b22e-4be39cf22a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d806a7e5-3fc3-41e8-a0c3-68f01b20863e", "tag": "61195d18-1dc2-42e7-aecc-14a342ca47f9"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:56.572676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.580091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.581722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.584538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-385ccd6e-3a76-4cb9-985b-82ec83af8db6 req-d6eaf60e-582b-448b-b22e-4be39cf22a88 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.585574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.586211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.588070 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-385ccd6e-3a76-4cb9-985b-82ec83af8db6 req-d6eaf60e-582b-448b-b22e-4be39cf22a88 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.588668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.593992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-385ccd6e-3a76-4cb9-985b-82ec83af8db6 req-d6eaf60e-582b-448b-b22e-4be39cf22a88 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.640846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-385ccd6e-3a76-4cb9-985b-82ec83af8db6 req-d6eaf60e-582b-448b-b22e-4be39cf22a88 service nova] Creating event network-changed:61195d18-1dc2-42e7-aecc-14a342ca47f9 for instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e on hv-cinder-85426 Aug 30 04:26:56.656128 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-385ccd6e-3a76-4cb9-985b-82ec83af8db6 req-d6eaf60e-582b-448b-b22e-4be39cf22a88 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098287 Aug 30 04:26:56.657915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 43/83] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:56.867707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.877742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9e414c93-2f1d-40ba-bb31-ab5e3aa0a191 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.328172 Aug 30 04:26:56.878324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 41/84] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:56 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:57.267168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:57.269074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:57.275376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.275851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.276277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.277165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.277609 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.278170 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.422709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.430648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e73624c-7bc4-4925-82a1-b295df9fd62b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.167573 Aug 30 04:26:57.431006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:57.431958 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 44/85] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:57.432080 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:57.440475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.440969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.441720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.442802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.443390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.443950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.608442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.618068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0cb9a075-003a-4bab-a887-3191a712b42c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.193887 Aug 30 04:26:57.629614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 42/86] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:57.900669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:57.901317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:57.907140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.907626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.908060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.908810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.909453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.909875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.039911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:58.047800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eb7d809d-15c8-415d-97f9-1642134fa9c3 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.151070 Aug 30 04:26:58.048766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 45/87] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:58.453169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.453772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:58.463988 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.464475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.464909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.465637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.466087 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.466505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.599221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:58.607364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-540d85e5-dd5d-4465-b7fb-ac4f26d87c03 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.158001 Aug 30 04:26:58.608134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 43/88] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:58 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:58.644254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.644864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:58.651080 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.651629 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.652068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.652758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.653259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.653678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.736061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-68b8b263-52ad-47a1-be59-90446159944f req-7a51c072-880f-4289-a9e4-fbd5378fea36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d93d3bc-5adc-40f9-b372-b24ded320831", "tag": "7064d357-6bbe-4302-95ac-eab03664669a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:58.749773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-68b8b263-52ad-47a1-be59-90446159944f req-7a51c072-880f-4289-a9e4-fbd5378fea36 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.750452 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-68b8b263-52ad-47a1-be59-90446159944f req-7a51c072-880f-4289-a9e4-fbd5378fea36 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.751082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-68b8b263-52ad-47a1-be59-90446159944f req-7a51c072-880f-4289-a9e4-fbd5378fea36 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.764654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-68b8b263-52ad-47a1-be59-90446159944f req-7a51c072-880f-4289-a9e4-fbd5378fea36 service nova] Creating event network-changed:7064d357-6bbe-4302-95ac-eab03664669a for instance 3d93d3bc-5adc-40f9-b372-b24ded320831 on hv-cinder-85426 Aug 30 04:26:58.769774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-68b8b263-52ad-47a1-be59-90446159944f req-7a51c072-880f-4289-a9e4-fbd5378fea36 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038311 Aug 30 04:26:58.770609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 44/89] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:58.805899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:58.824649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3aadb6f0-6a34-4656-804c-4b70bab06377 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.184684 Aug 30 04:26:58.825365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 46/90] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:58 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:59.069622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:59.070393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:59.076870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:59.077570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:59.078202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:59.078901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:59.079891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:59.080323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:59.214836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:59.223352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b8c3d8b2-df75-4dac-9417-65d563e53dd8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.158021 Aug 30 04:26:59.223928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 45/91] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:59 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:59.631002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:59.633103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:59.641148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:59.642684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:59.644245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:59.648245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:59.650523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:59.651625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:59.847217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:59.848033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:59.859391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:59.861656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:59.862867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:59.871001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:59.871482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:59.872139 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:00.162290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:00.174888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-72058b67-271a-49be-925b-5a6e8b76e6b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.548400 Aug 30 04:27:00.176733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 47/92] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:59 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:00.246214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:00.247185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:00.260833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:00.261492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:00.261986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:00.264045 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:00.264665 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:00.266524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:00.339259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:00.347824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a59309d1-4bef-4e5f-b57d-34c568e1df8a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.505736 Aug 30 04:27:00.348481 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 46/93] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:59 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:00.816207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:00.832165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0814853c-7bc9-4c19-89aa-fcf57445ae7c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.589834 Aug 30 04:27:00.843447 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 48/94] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:00 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:01.200399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:01.202499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:01.225866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.226562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.227210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.228169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.228732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.229300 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.367839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:01.368459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:01.375079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.375763 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.376203 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.376905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.377916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.378589 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.394395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:01.415450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c7b7f211-08cf-45e6-b27b-970743fb3a66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.220740 Aug 30 04:27:01.421700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 47/95] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:01.537601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:01.548332 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7549da84-1572-4fde-a763-3ada0b1794b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.184433 Aug 30 04:27:01.549090 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 49/96] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:01.851552 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:01.852159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:01.858321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.858790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.859216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.860068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.860657 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.861103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.997019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:02.007347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-df3af366-aac9-418c-ab34-080ea3d2aaa8 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.159587 Aug 30 04:27:02.008048 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 48/97] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:02.449532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:02.451313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:02.461487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.462357 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.463533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.465211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.465964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.466660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.571866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:02.572481 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:02.586513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.587009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.587446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.588145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.588594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.589013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.934948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:02.943660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac7c87db-b86d-4696-af88-24b27a6d537a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.502349 Aug 30 04:27:02.947352 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 50/98] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:02 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:02.967903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:02.976885 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-05a2b2f5-0524-4a12-8e79-d476ae9b1f8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.409005 Aug 30 04:27:02.977553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 49/99] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:02 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:03.028558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:03.029471 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:03.036166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.036817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.037437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.038271 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.038859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.039426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.241320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:03.247945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-18f980b8-888b-40fd-8aa7-2e639e876798 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.223015 Aug 30 04:27:03.248682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 51/100] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:03 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:03.356730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-ffb86f90-7946-4ffe-96ea-5c67db85e3ed req-f26d686f-f04e-424e-b129-772fae00fcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f359fb4c-9bdc-4898-81b0-26ea768f4444", "name": "network-vif-plugged", "status": "completed", "tag": "05e9029b-f746-406c-93bb-e93c4ab2ecb9"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:03.366962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ffb86f90-7946-4ffe-96ea-5c67db85e3ed req-f26d686f-f04e-424e-b129-772fae00fcf2 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.367620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ffb86f90-7946-4ffe-96ea-5c67db85e3ed req-f26d686f-f04e-424e-b129-772fae00fcf2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.368255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ffb86f90-7946-4ffe-96ea-5c67db85e3ed req-f26d686f-f04e-424e-b129-772fae00fcf2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.372747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:03.382062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-ffb86f90-7946-4ffe-96ea-5c67db85e3ed req-f26d686f-f04e-424e-b129-772fae00fcf2 service nova] Creating event network-vif-plugged:05e9029b-f746-406c-93bb-e93c4ab2ecb9 for instance f359fb4c-9bdc-4898-81b0-26ea768f4444 on hv-cinder-85426 Aug 30 04:27:03.387144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-ffb86f90-7946-4ffe-96ea-5c67db85e3ed req-f26d686f-f04e-424e-b129-772fae00fcf2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109518 Aug 30 04:27:03.387878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 50/101] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:03.966449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:03.967065 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:03.973989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.974536 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.975022 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.975827 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.976303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.976724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.003637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:04.006327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:04.014215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:04.016344 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:04.017138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.019288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:04.019958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:04.020589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.202199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:04.210887 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-88b91953-8fc4-4ff3-a77e-d9adc015ee60 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.248304 Aug 30 04:27:04.211735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 52/102] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:03 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:04.245312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:04.253932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f578dc69-268a-4a83-9d29-b63e24c74fac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.257339 Aug 30 04:27:04.254586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 51/103] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:03 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:04.268680 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:04.269317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:04.275969 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:04.276865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:04.277334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.278037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:04.278476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:04.278885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.417821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:04.426032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5878603a-4f4a-4144-a5c5-40375889ec2a tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.161962 Aug 30 04:27:04.426598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 53/104] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:04 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:05.232063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.232682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:05.238611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.239176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.239614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.240305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.240760 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.241217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.275081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.275688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:05.282112 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.283025 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.283536 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.284231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.284675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.285111 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.438180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.447870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0e60c9bb-0c02-4204-95ff-afde97102fb4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.220001 Aug 30 04:27:05.449252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 52/105] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:05 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:05.459007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a85aebda-2fb8-4955-ae98-23059d7beaa0 req-a551f4f7-4b72-4090-9f02-8abb44100373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a97c5a-7835-4178-8975-f4ce0f14bcda", "name": "network-vif-plugged", "status": "completed", "tag": "2fdbdf3d-c596-40b2-9e74-2020a17a72ed"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:05.472485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.474706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a85aebda-2fb8-4955-ae98-23059d7beaa0 req-a551f4f7-4b72-4090-9f02-8abb44100373 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.475153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a85aebda-2fb8-4955-ae98-23059d7beaa0 req-a551f4f7-4b72-4090-9f02-8abb44100373 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.475659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a85aebda-2fb8-4955-ae98-23059d7beaa0 req-a551f4f7-4b72-4090-9f02-8abb44100373 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.476381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:05.486972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-121377bd-0bf9-4b7e-91ee-4cdc2bb56778 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.211123 Aug 30 04:27:05.489807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a85aebda-2fb8-4955-ae98-23059d7beaa0 req-a551f4f7-4b72-4090-9f02-8abb44100373 service nova] Creating event network-vif-plugged:2fdbdf3d-c596-40b2-9e74-2020a17a72ed for instance b6a97c5a-7835-4178-8975-f4ce0f14bcda on hv-cinder-85426 Aug 30 04:27:05.493410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 54/106] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:05 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:05.495063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a85aebda-2fb8-4955-ae98-23059d7beaa0 req-a551f4f7-4b72-4090-9f02-8abb44100373 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044160 Aug 30 04:27:05.495652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 53/107] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:05.503108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.503753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:05.509814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.510298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.510731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.511424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.511877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.512302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.655530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.663660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-76e9334c-fb38-4bb0-b6a9-0bc55f19a94f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.169089 Aug 30 04:27:05.664236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 55/108] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:05 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:06.470529 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.471942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.479241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.480111 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.480699 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.481600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.488504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.488952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.508993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.510229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.519664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.520367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.521289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.522229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.522686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.523978 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.709866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:06.719638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-05f83a0a-48e0-4c64-b53f-42707f0c482a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.253091 Aug 30 04:27:06.721218 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 54/109] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:06.726524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.727138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.735133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.735735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.736147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.737450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.737919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.738524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.752298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:06.760336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cc2c661f-55da-4094-b54f-2059138e9099 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.256880 Aug 30 04:27:06.769061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 56/110] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:06.905815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:06.918831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-854cd6c4-18ab-4d60-8c4b-708a9a006b4e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.196245 Aug 30 04:27:06.919937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 55/111] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:07.743478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:07.744630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:07.759718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:07.760301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:07.760744 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.766735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:07.767265 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:07.771583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.784716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:07.787196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:07.797470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:07.798586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:07.799760 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.800740 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:07.801653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:07.802282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.209742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:08.218949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-72a9c46e-814e-463f-a030-08d98f0d5750 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.479721 Aug 30 04:27:08.219534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 57/112] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:07 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:08.228233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:08.244661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4e0064f3-fe3a-4d47-8663-4f3957221f1c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.464522 Aug 30 04:27:08.245267 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 56/113] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:07 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:08.247422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.248205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:08.254685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.255160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.255591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.256279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.256722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.257195 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.261881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-8155436a-4b6e-4f27-97d4-f346d2325d8a req-8791767a-a3b2-48c4-a8c5-f45fe908c63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93d3bc-5adc-40f9-b372-b24ded320831", "name": "network-vif-plugged", "status": "completed", "tag": "7064d357-6bbe-4302-95ac-eab03664669a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:08.292811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8155436a-4b6e-4f27-97d4-f346d2325d8a req-8791767a-a3b2-48c4-a8c5-f45fe908c63e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.292811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8155436a-4b6e-4f27-97d4-f346d2325d8a req-8791767a-a3b2-48c4-a8c5-f45fe908c63e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.292811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8155436a-4b6e-4f27-97d4-f346d2325d8a req-8791767a-a3b2-48c4-a8c5-f45fe908c63e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.342788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-8155436a-4b6e-4f27-97d4-f346d2325d8a req-8791767a-a3b2-48c4-a8c5-f45fe908c63e service nova] Creating event network-vif-plugged:7064d357-6bbe-4302-95ac-eab03664669a for instance 3d93d3bc-5adc-40f9-b372-b24ded320831 on hv-cinder-85426 Aug 30 04:27:08.372700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-8155436a-4b6e-4f27-97d4-f346d2325d8a req-8791767a-a3b2-48c4-a8c5-f45fe908c63e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116103 Aug 30 04:27:08.375543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 57/114] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:08.683729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:08.699298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1b90160b-7f7c-4828-9dd1-f54e404f29ad tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.477100 Aug 30 04:27:08.700521 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 58/115] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:09.243460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:09.244385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:09.250796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.251211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.251716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.253006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.253478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.253888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.272859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:09.274897 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:09.282228 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.283113 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.283799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.284890 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.285553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.286162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.453671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:09.462649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7eb3678a-6248-4a8c-952c-826f3a5e13c8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.223531 Aug 30 04:27:09.463215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 58/116] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:09 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:09.466349 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:09.474708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-40897bfe-72dc-42a9-a427-08f8d0895606 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.211780 Aug 30 04:27:09.475256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 59/117] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:09 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:09.725954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:09.726379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:09.732798 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.733381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.733802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.734485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.735084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.735496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.900220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:09.912011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-50528153-208d-453c-afa7-5c63a3b62f9c tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.188519 Aug 30 04:27:09.912791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 59/118] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:09 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.491803 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.492914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:10.498261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.499677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:10.500630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.501392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.501874 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.502677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.503372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.504040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.509516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.510798 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.511451 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.512592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.513137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.513731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.751443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.755920 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.762035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-02963f0d-a18e-4934-af7a-4c110a1879eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.274276 Aug 30 04:27:10.762850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 60/119] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.776206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f6e6131f-258a-4013-934e-ecacd7324229 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1321 microversion: 2.1 time: 0.283583 Aug 30 04:27:10.777143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 60/120] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:10.934661 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.935368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:10.944135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.944655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.948861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.949774 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.953373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.953815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.090085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:11.098812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-af1d9bf8-a77e-4826-b58f-be69d10d64cb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.168881 Aug 30 04:27:11.099410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 61/121] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:11.784161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:11.784870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:11.793206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.793968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.794616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.795521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.796177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.796790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.797522 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:11.798446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:11.805627 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.808039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.808740 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.812387 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.813068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.814816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.243553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.260084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-46e466e9-a5ce-4b71-9747-7443060e5b61 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.477882 Aug 30 04:27:12.261359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 61/122] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:11 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:12.269189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:12.271133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:12.280469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.281938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.283184 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.283884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.286501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.287666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.288325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.290028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-befb8359-bab9-4bb3-96c6-b7c4f9924287 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1515 microversion: 2.1 time: 0.496380 Aug 30 04:27:12.306714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 62/123] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:11 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:12.317291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:12.320145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:12.330549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.331425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.332152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.333139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.333822 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.334475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.445200 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'flavor' on Instance uuid b6a97c5a-7835-4178-8975-f4ce0f14bcda {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:12.583722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5a91309a-91af-4330-9f5e-7464dffff6df tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda/action" status: 200 len: 32 microversion: 2.1 time: 0.272497 Aug 30 04:27:12.584487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 63/124] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:27:12 2022] POST /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda/action => generated 32 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:27:12.594549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-11399152-a42a-413c-a3d9-5cd9910fbf58 req-13a65853-0ee1-4f29-baaa-95395ba18045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d806a7e5-3fc3-41e8-a0c3-68f01b20863e", "name": "network-vif-plugged", "status": "completed", "tag": "61195d18-1dc2-42e7-aecc-14a342ca47f9"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:12.605620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-11399152-a42a-413c-a3d9-5cd9910fbf58 req-13a65853-0ee1-4f29-baaa-95395ba18045 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.606158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-11399152-a42a-413c-a3d9-5cd9910fbf58 req-13a65853-0ee1-4f29-baaa-95395ba18045 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.606617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-11399152-a42a-413c-a3d9-5cd9910fbf58 req-13a65853-0ee1-4f29-baaa-95395ba18045 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.618905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-11399152-a42a-413c-a3d9-5cd9910fbf58 req-13a65853-0ee1-4f29-baaa-95395ba18045 service nova] Creating event network-vif-plugged:61195d18-1dc2-42e7-aecc-14a342ca47f9 for instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e on hv-cinder-85426 Aug 30 04:27:12.624444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-11399152-a42a-413c-a3d9-5cd9910fbf58 req-13a65853-0ee1-4f29-baaa-95395ba18045 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033901 Aug 30 04:27:12.625329 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 64/125] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:12.630767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:12.631643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:12.638573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.639055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.639654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.640878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.641394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.641992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.845728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.854196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0df46997-fd9a-49d4-8f9c-2448fc901756 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.591468 Aug 30 04:27:12.855045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 62/126] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:12 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:13.119800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:13.127884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-30a5491b-270d-4264-a1ad-a6aa69d7b5e2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.501359 Aug 30 04:27:13.137208 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 65/127] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:12 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:13.285065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:13.285879 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:13.307940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.308604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.309081 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.309802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.311582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.313152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.513926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:13.525570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c87e250e-5974-49d9-a047-ffa82eda6559 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.245632 Aug 30 04:27:13.526937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 63/128] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:13 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:13.878117 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:13.878857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:13.887942 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.888675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.889603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.890376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.891478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.891907 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.105948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:14.116772 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9b613b91-cfe9-49d9-a17b-e5ea77acbafb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.244483 Aug 30 04:27:14.118154 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 66/129] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:13 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:14.148589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:14.149785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:14.159807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.160493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.161282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.162942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.164046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.165081 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.396055 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:14.406855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fe12b524-6a79-46cd-8aea-1a7dc09cd28c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.260481 Aug 30 04:27:14.406855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 64/130] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:14 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:14.549361 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:14.550102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:14.559352 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.559833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.560445 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.561327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.561968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.562569 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.852552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:14.862377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e6566cb2-8aa4-49e8-854f-e8d74fd21fd8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1363 microversion: 2.1 time: 0.318523 Aug 30 04:27:14.865011 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 67/131] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:14 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:15.141152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:15.142147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:15.151673 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.152307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.153281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.153883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.154295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.353811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:15.362258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7e6a345e-7159-42af-a2a4-cd19644ae4c0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.226801 Aug 30 04:27:15.363383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 65/132] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:15 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:15.430485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:15.431343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:15.440210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.443566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.444835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.446780 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.447974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.449907 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.697792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:15.706823 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a0e27b6e-069e-41be-bddd-051761eddcbd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.282943 Aug 30 04:27:15.707706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 68/133] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:15 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:15.888659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:15.889291 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:15.903114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.903772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.904347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.905248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.905904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.906472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.166738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:16.189905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d0456367-52c8-4502-af2e-6ebd4c02eb29 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1548 microversion: 2.1 time: 0.295578 Aug 30 04:27:16.189905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 66/134] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:15 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1548 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:16.210946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:16.211441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:16.219288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.223884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.224365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.225295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.226157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.226603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.335398 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ff63669e-0a49-48a3-bc5e-04ba805c0f75 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128541 Aug 30 04:27:16.336267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 69/135] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:27:16 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:16.385581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:16.386354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:16.402586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.403465 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.404127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.406327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.412593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.413471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.718383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:16.730173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:16.730744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5ec9dd6c-c607-4b26-ba81-72ae462c2336 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.349433 Aug 30 04:27:16.731234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 67/136] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:16 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:16.731898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:16.743197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.743785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.745532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.747353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.749067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.749689 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.788615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:17.056442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:17.067985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ae9ecb0e-b569-4241-b30c-ccf79a54806a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.338967 Aug 30 04:27:17.069269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 70/137] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:16 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:17.753690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:17.754326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:17.760188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:17.760955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:17.761522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:17.762296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:17.762839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:17.763325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:17.927691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:17.931767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:17.940269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-23c9508c-43d6-415b-bf85-a26373e90ce1 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.189916 Aug 30 04:27:17.953949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 68/138] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:17 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:18.090863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:18.092269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:18.104554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.105432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.106129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.107168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.107810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.108424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.356074 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-964df4c9-4f33-400a-a4c8-6eb044a2db19 req-f07ed268-981c-4c21-8912-dc763bdac41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d93d3bc-5adc-40f9-b372-b24ded320831", "tag": "7064d357-6bbe-4302-95ac-eab03664669a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:18.370441 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-964df4c9-4f33-400a-a4c8-6eb044a2db19 req-f07ed268-981c-4c21-8912-dc763bdac41e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.370676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:18.371268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-964df4c9-4f33-400a-a4c8-6eb044a2db19 req-f07ed268-981c-4c21-8912-dc763bdac41e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.372013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-964df4c9-4f33-400a-a4c8-6eb044a2db19 req-f07ed268-981c-4c21-8912-dc763bdac41e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.384469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5f10254f-5cae-4d51-b254-63fc6939580f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.298685 Aug 30 04:27:18.386917 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-964df4c9-4f33-400a-a4c8-6eb044a2db19 req-f07ed268-981c-4c21-8912-dc763bdac41e service nova] Creating event network-changed:7064d357-6bbe-4302-95ac-eab03664669a for instance 3d93d3bc-5adc-40f9-b372-b24ded320831 on hv-cinder-85426 Aug 30 04:27:18.389934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 71/139] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:18 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:18.402926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-964df4c9-4f33-400a-a4c8-6eb044a2db19 req-f07ed268-981c-4c21-8912-dc763bdac41e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050903 Aug 30 04:27:18.406883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 69/140] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:18.961867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:18.962791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:18.970885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.971727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.972377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.973347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.974019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.974539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.407583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:19.408327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:19.416152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.416374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:19.416838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.417210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.418440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.419102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.419727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.426396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1807282c-a9b0-416e-9963-0551a434f10f tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1314 microversion: 2.1 time: 0.468668 Aug 30 04:27:19.426972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 72/141] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:18 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:19.627764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:19.640865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-68a96d26-f455-4088-892f-66c119b924f7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.237894 Aug 30 04:27:19.645069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 70/142] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:19 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:20.065074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1821799007", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "networks": [{"uuid": "bc930985-4717-47a0-be1a-d96b32a3da9c"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:20.140866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] validate_networks() for [('bc930985-4717-47a0-be1a-d96b32a3da9c', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:27:20.454024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:20.456327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:20.472045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.472744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.473211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.473916 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.474371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.474785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.757625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:20.767908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f6a7909c-a7e0-4597-9de5-31df81a83fc4 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1501 microversion: 2.1 time: 0.318451 Aug 30 04:27:20.774704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:20.775180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:20.775901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:20.776344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:20.776753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:20.779329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 71/143] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:20 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1501 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:20.789831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:20.790450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:20.793996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=78 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:20.801499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.801991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.802951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.803115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.804023 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.804234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.804834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.806222 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.806908 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.808726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.808849 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.810270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.838160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Getting quotas for project 2d8842fc1da94bf681eeb42464032b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:20.844654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Getting quotas for user 3a25d172babb4cd698fac79d7412d25b and project 2d8842fc1da94bf681eeb42464032b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:20.859091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:20.862165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:20.925701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5f42a446-b87b-4374-8222-32397cb94586 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862894 Aug 30 04:27:20.929004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 73/144] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:20.941378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7917595c-2188-45f7-aa25-57580a840d7b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:20.942217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7917595c-2188-45f7-aa25-57580a840d7b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:21.042805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7917595c-2188-45f7-aa25-57580a840d7b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:21.061018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7917595c-2188-45f7-aa25-57580a840d7b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1219 microversion: 2.1 time: 0.122720 Aug 30 04:27:21.064247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 74/145] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:20 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:21.120845 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:21.130333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6146c7ea-dcd0-4bef-8bdf-4410d6bd7b2c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.349717 Aug 30 04:27:21.130910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 72/146] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:20 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:22.085023 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:22.086167 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:22.093767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.094255 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.094681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.096105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.096558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.096981 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.154558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:22.155709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:22.171576 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:22.175788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.176495 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.177950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.179338 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.181249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ad35559e-e8f1-4384-8667-ac1b7ae52502 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1271 microversion: 2.1 time: 0.102004 Aug 30 04:27:22.181950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.184802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.194389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 75/147] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:22 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:22.376170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:22.392367 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52681c38-d9fc-4202-a40e-33d39e5a5edc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.242643 Aug 30 04:27:22.394192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 73/148] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:22 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:22.478020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99de3522-46ee-4560-8067-bc94063d5856"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:22.480689 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:22.487516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.488028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.488455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.489390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.489843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.490339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.078225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac63ec79-9a8d-4d5d-9261-815db7217eb0 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "POST /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604529 Aug 30 04:27:23.084820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 76/149] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:27:22 2022] POST /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:23.207404 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:23.208022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:23.214256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:23.214737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:23.215159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.215872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:23.216317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:23.216727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.285175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:23.293342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2cc8e86e-0fa2-49c0-891e-5c3fbf607f69 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1277 microversion: 2.1 time: 0.091458 Aug 30 04:27:23.293923 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 74/150] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:23 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:23.417318 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:23.418221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:23.421171 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:23.449824 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:23.450314 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:23.450743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.451436 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:23.451876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:23.452654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.681902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:23.691139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3d475422-c559-4a22-9757-da4e45069883 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.279852 Aug 30 04:27:23.692032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 77/151] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:23 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:24.318205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:24.319546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:24.325636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.326124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.326557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.327254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.327702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.328121 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.503624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-4387721e-8848-4d7b-88d1-a3c8cc413ab8 req-3dfdd28a-8ca3-46bf-870b-8197a7c6fb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53019836-c870-4c39-b085-179b6fb4e517", "tag": "0fcce26e-b672-4e4b-aea3-9d7cd3bc24ba"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:24.509009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:24.525069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d0be71f2-31b9-4597-bb88-fcd64889f9d7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.211241 Aug 30 04:27:24.528295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-4387721e-8848-4d7b-88d1-a3c8cc413ab8 req-3dfdd28a-8ca3-46bf-870b-8197a7c6fb74 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.529124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-4387721e-8848-4d7b-88d1-a3c8cc413ab8 req-3dfdd28a-8ca3-46bf-870b-8197a7c6fb74 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.530305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-4387721e-8848-4d7b-88d1-a3c8cc413ab8 req-3dfdd28a-8ca3-46bf-870b-8197a7c6fb74 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.534975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 75/152] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:24 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:24.556125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-4387721e-8848-4d7b-88d1-a3c8cc413ab8 req-3dfdd28a-8ca3-46bf-870b-8197a7c6fb74 service nova] Creating event network-changed:0fcce26e-b672-4e4b-aea3-9d7cd3bc24ba for instance 53019836-c870-4c39-b085-179b6fb4e517 on hv-cinder-85426 Aug 30 04:27:24.564553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-4387721e-8848-4d7b-88d1-a3c8cc413ab8 req-3dfdd28a-8ca3-46bf-870b-8197a7c6fb74 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066841 Aug 30 04:27:24.566125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 78/153] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:24.714507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:24.715235 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:24.721903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.722738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.723292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.725483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.726122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.726866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.952196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:24.961129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d96b35b1-d84c-42ad-8b54-b18704f7fa04 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.250519 Aug 30 04:27:24.975063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 76/154] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:24 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:25.551555 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:25.552248 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:25.559365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.559848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.560281 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.560965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.561442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.561861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.735132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:25.748641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f1072167-98d0-4002-bcf9-4e4fe30291de tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.201705 Aug 30 04:27:25.749728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 79/155] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:25 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:25.982423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:25.983883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:25.991160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.991648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.992083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.992819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.993307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.993727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.136904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:26.144669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ebd84693-41b8-436f-891c-ad64024dd22c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.166120 Aug 30 04:27:26.145283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 77/156] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:25 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:26.770815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:26.771429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:26.778633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.783382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.783999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.784737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.800842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.800842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.969114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:26.978518 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68c56b71-db97-427a-9740-8cec649efee6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.212081 Aug 30 04:27:26.979156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 80/157] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:26 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:27.165965 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:27.166581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:27.172622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.173169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.173603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.174341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.174789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.175216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.332896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:27.341096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ec65b8a7-ef44-4afa-a049-dc56a45a79f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.179142 Aug 30 04:27:27.341687 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 78/158] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:27 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:28.000530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:28.001697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:28.011130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.011625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.012059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.013581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.014018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.014603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.212950 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:28.228269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-748593d2-ec49-4837-b21c-16f52fea08fe tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.231445 Aug 30 04:27:28.229078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 81/159] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:27 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:28.362814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:28.363433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:28.371753 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.372523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.373193 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.374088 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.374758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.375393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.602998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:28.617920 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-85741dac-9be1-42b8-acbb-b72aed678197 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.259727 Aug 30 04:27:28.618716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 79/160] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:28 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:29.252583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:29.253932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:29.306527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.310142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.312287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.316317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.317197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.319481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.558267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:29.567255 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4ac742e3-ec34-4890-9c74-dda6ba689842 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.320879 Aug 30 04:27:29.568386 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 82/161] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:29 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:29.639632 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:29.640504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:29.649410 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.649792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.650548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.651241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.651684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.652100 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.835190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:29.844356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3e144460-8023-4c5c-ac07-23dcef466a25 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.208767 Aug 30 04:27:29.844974 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 80/162] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:29 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:30.035327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:30.035890 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.042952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.043459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.044081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.044664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.045138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.045562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.072782 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:27:30.165312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-922a9ac8-95d1-4fbc-9e12-240d9ade4346 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 204 len: 0 microversion: 2.1 time: 0.133933 Aug 30 04:27:30.166051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 83/163] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:27:30 2022] DELETE /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:30.174753 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:30.175395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.181318 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.181798 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.182220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.183390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.183837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.184253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.347844 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.356148 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5841d7e1-bdc5-42d8-b952-a8552f4a3107 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.185741 Aug 30 04:27:30.356827 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 81/164] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:30 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:30.591848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:30.595223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.601873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.602357 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.602952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.603653 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.604102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.604529 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.750444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.759344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-64ad80f6-b3a5-4d2d-9dc8-cca51c027fcc tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.172102 Aug 30 04:27:30.759912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 84/165] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:30 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:30.867655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:30.868656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.875543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.876290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.876880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.877706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.878274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.878715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.027352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:31.043592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-23e08135-4f74-4054-9ee1-d7a49dd23811 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.179928 Aug 30 04:27:31.044367 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 82/166] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:30 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:31.378732 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:31.379523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:31.382556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:31.383732 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=8 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:31.387420 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.387954 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.388389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.389142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.390164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.390615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.544399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:31.554947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cf8f3a84-199a-4f41-8b28-06c178727dcb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.180239 Aug 30 04:27:31.555534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 85/167] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:31 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:31.780478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:31.781447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:31.788516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.789366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.790084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.790869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.791326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.791935 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.979315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:31.988271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eed6b0be-b187-44c8-876e-290847693acb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.212440 Aug 30 04:27:31.988930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 83/168] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:31 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:32.065522 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:32.066806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:32.073244 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.073734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.074164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.074852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.075303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.075727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.093917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:32.219181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:32.226748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d7b9a530-7bb0-43ed-9d49-238ad6f8df26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.165852 Aug 30 04:27:32.227353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 86/169] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:32 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:32.576298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:32.577115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:32.583697 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.584177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.584601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.585361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.585783 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.586195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.715801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:32.732578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fcf7f563-f49c-4f4e-b806-5a06cf0971ba tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.160471 Aug 30 04:27:32.733375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 84/170] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:32 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:33.009351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:33.009991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:33.017554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.018055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.018467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.019160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.019604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.020021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.155714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.163631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-be27159b-5045-42b6-a9af-7a0b887355c8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.158302 Aug 30 04:27:33.164199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 87/171] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:33 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:33.248469 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:33.249175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:33.255915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.256401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.256838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.257561 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.258011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.258462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.397966 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.407720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-855e5ea8-2605-4f07-bfd5-800c90f610a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.163200 Aug 30 04:27:33.408691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 85/172] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:33 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:33.754369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:33.754960 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:33.760791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.761300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.761724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.762395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.762835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.763245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.903790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.912649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b2e0d8aa-927c-4bff-b1fc-30151b5a54e7 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.162708 Aug 30 04:27:33.913235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 88/173] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:33 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.184090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.184623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.190566 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.191041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.191463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.192139 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.192582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.192999 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.195528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:34.323130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.331196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f48e0747-c548-492f-b6b2-6d457da50374 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.151034 Aug 30 04:27:34.331808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 86/174] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.428108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.428798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.435511 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.435929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.436359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.437064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.437522 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.437945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.580941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.581753 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-9da0171f-40f5-4b3d-8a65-13daaefc34cb req-3b0a72e7-05f9-40d4-a1a3-c8d3f793147e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53019836-c870-4c39-b085-179b6fb4e517", "name": "network-vif-plugged", "status": "completed", "tag": "0fcce26e-b672-4e4b-aea3-9d7cd3bc24ba"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:34.589799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-64335b6c-95bd-42c6-9e8a-b960c905d869 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.165174 Aug 30 04:27:34.590498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 89/175] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.593287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-9da0171f-40f5-4b3d-8a65-13daaefc34cb req-3b0a72e7-05f9-40d4-a1a3-c8d3f793147e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.593996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-9da0171f-40f5-4b3d-8a65-13daaefc34cb req-3b0a72e7-05f9-40d4-a1a3-c8d3f793147e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.594420 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-9da0171f-40f5-4b3d-8a65-13daaefc34cb req-3b0a72e7-05f9-40d4-a1a3-c8d3f793147e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.606910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-9da0171f-40f5-4b3d-8a65-13daaefc34cb req-3b0a72e7-05f9-40d4-a1a3-c8d3f793147e service nova] Creating event network-vif-plugged:0fcce26e-b672-4e4b-aea3-9d7cd3bc24ba for instance 53019836-c870-4c39-b085-179b6fb4e517 on hv-cinder-85426 Aug 30 04:27:34.611816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-9da0171f-40f5-4b3d-8a65-13daaefc34cb req-3b0a72e7-05f9-40d4-a1a3-c8d3f793147e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034817 Aug 30 04:27:34.612394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 87/176] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:34.933880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.934585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.941359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.941838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.942260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.943000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.943443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.943855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.982343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1119655950", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "networks": [{"uuid": "5b04d9ed-8f32-46c9-8e1b-21119d73cac4"}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:35.036510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] validate_networks() for [('5b04d9ed-8f32-46c9-8e1b-21119d73cac4', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:27:35.134388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:35.142852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5f208390-ceda-4280-a144-427194770feb tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.212710 Aug 30 04:27:35.151446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 90/177] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:35.351924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.352538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:35.358421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.358904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.359331 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.360017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.360472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.360894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.468381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:35.468859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:35.469436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:35.469907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:35.470378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:35.479420 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.479911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.480328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.481059 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.481548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.481962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.498626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Getting quotas for project bdbf61cc87384ade8eb07b032bb6292b. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:35.502987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Getting quotas for user 148a7e11786a4a54909c4a0679407b80 and project bdbf61cc87384ade8eb07b032bb6292b. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:35.512658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:35.514180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:35.516530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:35.520911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0341c951-eec3-45b5-b587-8a44e2ad489a tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.172813 Aug 30 04:27:35.521498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 91/178] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:35.564799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3ff99ff8-8981-4bc1-9d26-0de16636bb47 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586527 Aug 30 04:27:35.565480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 88/179] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:27:35.577421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e21f68cd-6fe0-40dc-9302-01f999ad36d8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.578139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e21f68cd-6fe0-40dc-9302-01f999ad36d8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:35.612237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.613130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:35.620384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.621101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.621702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.622720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.623319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.623895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.661935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e21f68cd-6fe0-40dc-9302-01f999ad36d8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:35.669863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e21f68cd-6fe0-40dc-9302-01f999ad36d8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1214 microversion: 2.1 time: 0.096811 Aug 30 04:27:35.670957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 92/180] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:35.782534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:35.791221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2e23a0b9-e562-4819-ab12-2a5089772213 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.183831 Aug 30 04:27:35.791786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 89/181] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:36.163523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.164135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.170124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.170601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.171030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.171707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.172158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.172582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.302779 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.311192 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ef98483b-b3f3-4ef6-9ccc-329d85898f84 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.151558 Aug 30 04:27:36.311946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 93/182] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:36.542261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.542652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.548144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.548616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.549054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.549741 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.550207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.551487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.690932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.692173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.698973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.699454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.699877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.700561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.701004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.701448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.702398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.712795 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9510687c-00e1-40c6-93ed-276a3509c8d6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.174812 Aug 30 04:27:36.725312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 90/183] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:36.776661 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.785366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-57ec037c-de90-46d4-94c7-c6f1bc45b386 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1218 microversion: 2.1 time: 0.098324 Aug 30 04:27:36.785940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 94/184] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:36.813304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.814336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.820756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.821553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.822095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.822938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.823499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.824007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.962705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.971415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-790fcbc8-f73c-4f7d-96f7-02f43ce1b1b2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.162018 Aug 30 04:27:36.972017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 91/185] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.332624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.333259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.338990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.339462 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.339897 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.340551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.340991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.341426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.506614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.514748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-415199f6-4a48-4a77-87bb-848bb7ecf9bd tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.185856 Aug 30 04:27:37.515321 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 95/186] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.734849 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.736192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.743538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.744275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.744701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.745425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.745871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.746328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.805711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.806540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.813172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.813800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.814315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.815228 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.815872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.816625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.889997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.900981 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1d0f3260-99ab-4777-9671-70a718ecb65d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1266 microversion: 2.1 time: 0.099110 Aug 30 04:27:37.901633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 96/187] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:37.910467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.918579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6bfadf34-1678-4fc5-af42-d3eeef01f37f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.187534 Aug 30 04:27:37.919140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 92/188] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.993528 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.994415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.000230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.000906 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.001375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.002037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.002481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.002893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.145627 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:38.153849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d1d9f3b7-0372-4e62-8332-4ffacb2530e0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.163957 Aug 30 04:27:38.154748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 97/189] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:38.535737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.536386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.542619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.543147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.543580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.544437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.544865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.545335 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.682074 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:38.691959 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-918b0386-6025-4a2c-b8db-ed9d8a4d145e tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1553 microversion: 2.1 time: 0.160071 Aug 30 04:27:38.692722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 93/190] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:38.923507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.924217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.931518 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.932086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.932703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.933499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.934184 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.934674 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.940079 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.940691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.947555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.948043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.948599 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.949587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.950346 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.950773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.004119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.014680 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ada35509-314a-4183-9a2c-09043dc09739 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1266 microversion: 2.1 time: 0.093851 Aug 30 04:27:39.015276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 98/191] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:39.105656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.114372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-54a2a027-edad-449b-9818-2a267ffe5509 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1319 microversion: 2.1 time: 0.179083 Aug 30 04:27:39.114931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 94/192] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:39.176376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.177028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:39.183136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.183625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.184147 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.184736 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.185220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.185649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.324748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.349157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-03c15f75-f7d0-4910-8c3d-57538a9e83f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.177195 Aug 30 04:27:39.350102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 99/193] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:39 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:39.573196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-7ef6ac11-fa69-4264-9e07-3150db44baea req-6607bbc3-0e94-4cc2-9471-03349b0b3626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d806a7e5-3fc3-41e8-a0c3-68f01b20863e", "name": "network-vif-deleted", "tag": "61195d18-1dc2-42e7-aecc-14a342ca47f9"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:39.585413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7ef6ac11-fa69-4264-9e07-3150db44baea req-6607bbc3-0e94-4cc2-9471-03349b0b3626 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.586093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7ef6ac11-fa69-4264-9e07-3150db44baea req-6607bbc3-0e94-4cc2-9471-03349b0b3626 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.586690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7ef6ac11-fa69-4264-9e07-3150db44baea req-6607bbc3-0e94-4cc2-9471-03349b0b3626 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.602875 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-7ef6ac11-fa69-4264-9e07-3150db44baea req-6607bbc3-0e94-4cc2-9471-03349b0b3626 service nova] Creating event network-vif-deleted:61195d18-1dc2-42e7-aecc-14a342ca47f9 for instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e on hv-cinder-85426 Aug 30 04:27:39.608352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-7ef6ac11-fa69-4264-9e07-3150db44baea req-6607bbc3-0e94-4cc2-9471-03349b0b3626 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038532 Aug 30 04:27:39.608995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 95/194] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:39.714324 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.715112 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:39.722921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.724129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.724650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.725757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.726426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.727310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.816966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.825217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8b8071f1-ddd2-4681-a702-1a00f140d470 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1511 microversion: 2.1 time: 0.115607 Aug 30 04:27:39.825783 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 100/195] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:39 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1511 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:40.037544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.038263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.049643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.050133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.051733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.052448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.052904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.053354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.126973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.135480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4c4eaee3-b4ff-4328-8ec1-f219ea1b869c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1274 microversion: 2.1 time: 0.103531 Aug 30 04:27:40.136053 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.139103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 96/196] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:40.139206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.144278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.145119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.145808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.146700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.147287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.147712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.289341 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.303342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c3b9c3b2-a4d3-4069-85db-c9c17ebe7d50 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1507 microversion: 2.1 time: 0.171658 Aug 30 04:27:40.303911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 101/197] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:40.372460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.373566 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.383780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.384586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.385186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.386317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.387083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.387697 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.537648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.545768 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-51cf5d66-7637-482b-9ae2-25b220d7cb96 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.178875 Aug 30 04:27:40.546408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 97/198] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:40.847417 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.848029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.854509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.854509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.854919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.855762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.856109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.856557 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.925790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.933852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-abf92722-83ee-4adc-b7af-32c270063e58 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1345 microversion: 2.1 time: 0.090435 Aug 30 04:27:40.934409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 102/199] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:41.158272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:41.161487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:41.175605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.179461 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.180135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.181023 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.181580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.184874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.266310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:41.275031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f8a94505-b2f9-46a6-a55f-3792ffa62680 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1284 microversion: 2.1 time: 0.120531 Aug 30 04:27:41.275610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 98/200] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:41 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:41.566513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:41.567175 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:41.573873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.574359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.575017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.575916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.576568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.577176 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.762481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:41.775507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-138157aa-5971-440c-8719-60caeeb590a0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.212672 Aug 30 04:27:41.792144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 103/201] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:41 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:41.955522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:41.956043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:41.961920 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.962565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.962996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.963676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.964122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.964545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.000549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.001560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.002060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.002714 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lazy-loading 'fault' on Instance uuid d806a7e5-3fc3-41e8-a0c3-68f01b20863e {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:42.057942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.069905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a0481bf8-054d-4924-ae2a-6ab3898de745 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1350 microversion: 2.1 time: 0.118397 Aug 30 04:27:42.072341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 99/202] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:41 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:42.296692 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:42.297340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:42.304617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.305127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.305726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.306768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.307357 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.307918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.312582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:42.445316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.453068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f399ce0a-6bf8-43a3-8768-000539e474b6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.160549 Aug 30 04:27:42.453644 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 104/203] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:42 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:42.606932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-292f0ed9-f48d-445c-9138-426266b69026 req-702b8603-7d78-4df0-b81b-417d78ccd159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e41893-a6f9-419c-a450-9b8233aff17f", "tag": "bb40c801-45f5-4a6a-912d-08b3f12cb066"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:42.616628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-292f0ed9-f48d-445c-9138-426266b69026 req-702b8603-7d78-4df0-b81b-417d78ccd159 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.617212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-292f0ed9-f48d-445c-9138-426266b69026 req-702b8603-7d78-4df0-b81b-417d78ccd159 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.617723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-292f0ed9-f48d-445c-9138-426266b69026 req-702b8603-7d78-4df0-b81b-417d78ccd159 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.629496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-292f0ed9-f48d-445c-9138-426266b69026 req-702b8603-7d78-4df0-b81b-417d78ccd159 service nova] Creating event network-changed:bb40c801-45f5-4a6a-912d-08b3f12cb066 for instance 48e41893-a6f9-419c-a450-9b8233aff17f on hv-cinder-85426 Aug 30 04:27:42.634215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-292f0ed9-f48d-445c-9138-426266b69026 req-702b8603-7d78-4df0-b81b-417d78ccd159 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031088 Aug 30 04:27:42.634970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 100/204] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:42.801399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:42.802013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:42.808373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.808856 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.809320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.810013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.810448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.810868 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.944012 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.952428 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bddfbe61-1f0c-431c-be48-410984bd8895 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.155356 Aug 30 04:27:42.952998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 105/205] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:42 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:43.096835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.097633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.103933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.104404 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.104838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.106194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.106674 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.107096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.139401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.139870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.140302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.145620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lazy-loading 'fault' on Instance uuid d806a7e5-3fc3-41e8-a0c3-68f01b20863e {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:43.196199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298b05a8580946f4ab2ed66f0b9a3c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959853ec613f47819ed2883c8539b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:43.212963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cffe22ad-9f76-4e07-baa2-5d432add7829 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 200 len: 1350 microversion: 2.1 time: 0.119967 Aug 30 04:27:43.214976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 101/206] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:43.475384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.476238 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.483033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.483798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.484279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.485125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.485571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.486024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.832205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:43.845315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3e7dd77f-3f5e-4c50-9337-cc3af0d9739a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.369366 Aug 30 04:27:43.845315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 106/207] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:43.973238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.973854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.980156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.980641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.981181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.981872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.982324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.982947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.127840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:44.135643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d19c2fd1-78c6-4d18-a768-6902360e97e9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.166516 Aug 30 04:27:44.136208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 102/208] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:44.238726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:44.239335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:44.245552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.246033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.246456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.247130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.247745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.248160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.262600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] HTTP exception thrown: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Request method failure captured: Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e HTTP/1.1 Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZF1x85gGt0X-sUc-1osLnQgmrzw6AUkVrUnHRO9KlNyMFfHDKSAVIr7rF5iJFrCLAQ10qsCnPhrTb1z5TUkaO85863-XSJVne5F4Mf6VT_DRVdVAOld-kBu-w6mwo3vzxQVYYgjRVSlLgwbUQdA0ioVG8y-UID9cxrJERJI3szPNYQ Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:27:44.267234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/959853ec613f47819ed2883c8539b24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_959853ec613f47819ed2883c8539b24e"}]}] Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 298b05a8580946f4ab2ed66f0b9a3c2b Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.268762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'd806a7e5-3fc3-41e8-a0c3-68f01b20863e'} Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:44.269666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.271040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.272218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Returning 404 to user: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:44.272218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0026798d-f375-456f-8e9a-7e6a26e02d78 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 404 len: 111 microversion: 2.1 time: 0.034357 Aug 30 04:27:44.272218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 107/209] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:44 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:44.378172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:44.380312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:44.386611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.387169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.387709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.388462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.388914 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.389414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.434746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] HTTP exception thrown: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Request method failure captured: Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e/os-volume_attachments HTTP/1.1 Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZF1x85gGt0X-sUc-1osLnQgmrzw6AUkVrUnHRO9KlNyMFfHDKSAVIr7rF5iJFrCLAQ10qsCnPhrTb1z5TUkaO85863-XSJVne5F4Mf6VT_DRVdVAOld-kBu-w6mwo3vzxQVYYgjRVSlLgwbUQdA0ioVG8y-UID9cxrJERJI3szPNYQ Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:27:44.439145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/959853ec613f47819ed2883c8539b24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_959853ec613f47819ed2883c8539b24e"}]}] Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 298b05a8580946f4ab2ed66f0b9a3c2b Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.440489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'server_id': 'd806a7e5-3fc3-41e8-a0c3-68f01b20863e'} Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:44.441280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:44.442627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:44.443940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Returning 404 to user: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:44.443940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-22791c65-4313-492c-9ed1-4fa9fa05fb92 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066310 Aug 30 04:27:44.443940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 103/210] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:44 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:44.861696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:44.862464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:44.869207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.869792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.870283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.871030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.871537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.872172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.023972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:45.044548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d941ff2d-bdea-439b-9de0-56c6bef73363 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.186581 Aug 30 04:27:45.045165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 108/211] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:44 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:45.158801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.159492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.165986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.166554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.166998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.167694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.168146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.168567 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.305616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:45.315459 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-298dbe17-adba-48c2-8262-90fe26f06fe8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.162229 Aug 30 04:27:45.316332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 104/212] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:45 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:45.642777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.643383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.650275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.651051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.652144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.653094 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.654236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.654869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.671718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:45.673963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] HTTP exception thrown: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Request method failure captured: Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e HTTP/1.1 Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZF1x85gGt0X-sUc-1osLnQgmrzw6AUkVrUnHRO9KlNyMFfHDKSAVIr7rF5iJFrCLAQ10qsCnPhrTb1z5TUkaO85863-XSJVne5F4Mf6VT_DRVdVAOld-kBu-w6mwo3vzxQVYYgjRVSlLgwbUQdA0ioVG8y-UID9cxrJERJI3szPNYQ Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:27:45.676086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/959853ec613f47819ed2883c8539b24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_959853ec613f47819ed2883c8539b24e"}]}] Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 298b05a8580946f4ab2ed66f0b9a3c2b Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.677360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'd806a7e5-3fc3-41e8-a0c3-68f01b20863e'} Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:45.678044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.679137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.682235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Returning 404 to user: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:45.683214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3f445e1c-b0a0-493d-91ed-24ee49a86d12 tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 404 len: 111 microversion: 2.1 time: 0.045115 Aug 30 04:27:45.683880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 109/213] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:27:45 2022] DELETE /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:45.692443 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.693368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] [instance: d806a7e5-3fc3-41e8-a0c3-68f01b20863e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.695900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:45.696973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:45.704256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.706157 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.706633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.707545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.708256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.708833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.728238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] HTTP exception thrown: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Request method failure captured: Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e HTTP/1.1 Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZF1x85gGt0X-sUc-1osLnQgmrzw6AUkVrUnHRO9KlNyMFfHDKSAVIr7rF5iJFrCLAQ10qsCnPhrTb1z5TUkaO85863-XSJVne5F4Mf6VT_DRVdVAOld-kBu-w6mwo3vzxQVYYgjRVSlLgwbUQdA0ioVG8y-UID9cxrJERJI3szPNYQ Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:27:45.730786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/959853ec613f47819ed2883c8539b24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/959853ec613f47819ed2883c8539b24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_959853ec613f47819ed2883c8539b24e"}]}] Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 959853ec613f47819ed2883c8539b24e Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375110515 Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 298b05a8580946f4ab2ed66f0b9a3c2b Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-DeleteServersTestJSON-1375110515-project Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.732746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'd806a7e5-3fc3-41e8-a0c3-68f01b20863e'} Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:45.733799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. Aug 30 04:27:45.735900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.737082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] Returning 404 to user: Instance d806a7e5-3fc3-41e8-a0c3-68f01b20863e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:45.737082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b7595209-dc3c-422d-beb3-42207cbb5c6b tempest-DeleteServersTestJSON-1375110515 tempest-DeleteServersTestJSON-1375110515-project] 10.222.0.85 "GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e" status: 404 len: 111 microversion: 2.1 time: 0.044152 Aug 30 04:27:45.737082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 105/214] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:45 2022] GET /compute/v2.1/servers/d806a7e5-3fc3-41e8-a0c3-68f01b20863e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:27:46.066839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:46.067654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:46.075584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.076393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.077161 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.078089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.078683 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.079408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.223348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:46.231054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d1098678-5eb4-4468-8032-e624fcc9bc6d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.168710 Aug 30 04:27:46.231621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 110/215] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:46 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:46.337549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:46.338161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:46.344918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.345448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.345884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.346573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.347022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.347442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.351503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:46.501290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:46.514648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-606f2342-581e-46b6-a71b-55c82828a9f6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.180978 Aug 30 04:27:46.517743 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 106/216] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:46 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:47.252754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.253479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.265855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.271723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.273599 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.277407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.278724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.279346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.539259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.540450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.548499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.549298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.549734 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.550597 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.551202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.551784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.562232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:47.572159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d09498ed-3bb9-4a9b-b45f-c64107cf0d74 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.324229 Aug 30 04:27:47.586163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 111/217] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:47.829291 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:47.858417 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c959d336-e6f8-4feb-b85a-99fb83b6f5e1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.323216 Aug 30 04:27:47.860078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 107/218] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:48.595615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:48.597016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:48.604582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.605399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.605976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.607128 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.607731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.608370 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.809401 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:48.817816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6d17dcbd-08a5-4d8b-a58c-937427385b6b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.226699 Aug 30 04:27:48.819322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 112/219] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:48 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:48.884247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:48.885006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:48.893580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.894940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.895665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.896572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.897457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.898097 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.091630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:49.106085 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8b477517-25e5-4708-ae86-4d24fab4bd47 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.226211 Aug 30 04:27:49.106890 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 108/220] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:48 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:49.155951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-6fb64b82-77cd-4ee9-beda-98ae5a9305db req-f584cd89-7e29-435c-aea3-f57e73573715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e41893-a6f9-419c-a450-9b8233aff17f", "name": "network-vif-plugged", "status": "completed", "tag": "bb40c801-45f5-4a6a-912d-08b3f12cb066"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:49.181991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6fb64b82-77cd-4ee9-beda-98ae5a9305db req-f584cd89-7e29-435c-aea3-f57e73573715 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.182607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6fb64b82-77cd-4ee9-beda-98ae5a9305db req-f584cd89-7e29-435c-aea3-f57e73573715 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.183213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6fb64b82-77cd-4ee9-beda-98ae5a9305db req-f584cd89-7e29-435c-aea3-f57e73573715 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.196566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-6fb64b82-77cd-4ee9-beda-98ae5a9305db req-f584cd89-7e29-435c-aea3-f57e73573715 service nova] Creating event network-vif-plugged:bb40c801-45f5-4a6a-912d-08b3f12cb066 for instance 48e41893-a6f9-419c-a450-9b8233aff17f on hv-cinder-85426 Aug 30 04:27:49.201603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-6fb64b82-77cd-4ee9-beda-98ae5a9305db req-f584cd89-7e29-435c-aea3-f57e73573715 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050505 Aug 30 04:27:49.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 113/221] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:49.845923 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:49.849273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:49.856948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.857718 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.858306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.859174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.860483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.861587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.129994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:50.130752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:50.153621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.154153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.154531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.155213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.155721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.156047 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.225418 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:50.249846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ba9e48bc-dfe7-46c1-b006-6f0653a1190b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.408772 Aug 30 04:27:50.268712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 109/222] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:49 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:50.612278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:50.627492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8848055f-1fd5-4377-9869-73543a769ec8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.502999 Aug 30 04:27:50.632664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 114/223] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:50 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:51.279020 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.280196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:51.284361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:51.297963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.305332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.306402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.307329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.309625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.310239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.585804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:51.599036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc1a69e0-cdc6-4e81-91de-3676de1df456 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1314 microversion: 2.1 time: 0.324563 Aug 30 04:27:51.614186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 110/224] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:51.658003 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.661176 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:51.675498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.677451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.678091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.679679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.681504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.685706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:52.128035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:52.139421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-88d8c9e6-d433-4ec6-a3f4-8863f399ddd9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.487249 Aug 30 04:27:52.146292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 115/225] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:52.635800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:52.637817 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:52.645655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:52.647166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:52.648062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:52.648928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:52.649721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:52.650297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:52.902887 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:52.911931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a4b570fe-ad10-45d1-9961-65767eefb97c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1497 microversion: 2.1 time: 0.294189 Aug 30 04:27:52.912542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 111/226] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:52 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1497 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:53.171051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:53.171984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.191402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.192982 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.196510 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.206949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.208597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.209410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.598096 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:53.611578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d5cfd66a-6702-44b8-9707-61af58940130 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.444942 Aug 30 04:27:53.613835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 116/227] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:53 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:54.256397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:54.256935 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:54.263051 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.263808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.264394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.265470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.266597 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.266971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.294429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:27:54.423202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a10a6d62-4af1-49d3-82c9-5eba108eaf56 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "DELETE /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 204 len: 0 microversion: 2.1 time: 0.172408 Aug 30 04:27:54.427912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 112/228] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:27:54 2022] DELETE /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:54.432827 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:54.435381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:54.446614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:54.448980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.449924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.450544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.451439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.452093 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.452698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.637278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:54.638408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:54.646661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.649564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.650434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.651444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.652276 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.653203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.870693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:54.879880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f4ae08cc-47d4-4c9b-a090-d6fa31553c9d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1503 microversion: 2.1 time: 0.450766 Aug 30 04:27:54.880914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 117/229] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:54 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1503 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:55.088262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:55.103466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc67e8c4-814c-4869-a1d7-3d6bc5514f27 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.471297 Aug 30 04:27:55.112065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 113/230] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:54 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:55.907494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:55.908155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:55.926335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:55.927062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:55.927509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:55.928241 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:55.928696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:55.929142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.133980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:56.134564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:56.145310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.145786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.146219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.146912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.147520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.148793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.263834 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:56.278127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8d06dfde-0500-44a5-9d14-f65e56b97aaf tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1503 microversion: 2.1 time: 0.377230 Aug 30 04:27:56.278733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 118/231] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:55 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:56.463232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:56.472279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8913e341-d6a7-4a94-828b-4fcd9b265275 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.342032 Aug 30 04:27:56.473480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 114/232] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:56 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:57.302734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:57.324911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:57.347431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:57.348173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:57.348711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:57.350140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:57.350841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:57.351480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:57.496443 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:57.502077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:57.520262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:57.522222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:57.522780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:57.524730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:57.527344 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:57.528282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:58.074532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:58.085623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9bf5d977-0fa9-4e5c-881e-0143f9d1a42a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1503 microversion: 2.1 time: 0.789554 Aug 30 04:27:58.091798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 119/233] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:57 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1503 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:58.498386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:58.513544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0c77622d-d71c-46a4-805d-c3eff4e8b641 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 1.018270 Aug 30 04:27:58.514448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 115/234] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:57 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:58.629444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-bcfc29f5-cb5d-420c-ac47-badbd653990c req-f68f2e2e-3359-4476-9af8-2bf2d4860c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e41893-a6f9-419c-a450-9b8233aff17f", "name": "network-vif-deleted", "tag": "bb40c801-45f5-4a6a-912d-08b3f12cb066"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:58.656945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bcfc29f5-cb5d-420c-ac47-badbd653990c req-f68f2e2e-3359-4476-9af8-2bf2d4860c85 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:58.670369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bcfc29f5-cb5d-420c-ac47-badbd653990c req-f68f2e2e-3359-4476-9af8-2bf2d4860c85 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:58.671303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bcfc29f5-cb5d-420c-ac47-badbd653990c req-f68f2e2e-3359-4476-9af8-2bf2d4860c85 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:58.698305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-bcfc29f5-cb5d-420c-ac47-badbd653990c req-f68f2e2e-3359-4476-9af8-2bf2d4860c85 service nova] Creating event network-vif-deleted:bb40c801-45f5-4a6a-912d-08b3f12cb066 for instance 48e41893-a6f9-419c-a450-9b8233aff17f on hv-cinder-85426 Aug 30 04:27:58.706896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-bcfc29f5-cb5d-420c-ac47-badbd653990c req-f68f2e2e-3359-4476-9af8-2bf2d4860c85 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091842 Aug 30 04:27:58.707502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 120/235] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:59.111808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:59.112858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:59.122777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.123283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.124173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.124410 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.124862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.125384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.284986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.284986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.284986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.284986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid 48e41893-a6f9-419c-a450-9b8233aff17f {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:59.391893 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:59.406185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-831d8081-cf65-4cc5-8d36-5cf13706b714 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 200 len: 1304 microversion: 2.1 time: 0.298110 Aug 30 04:27:59.407053 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 116/236] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:59 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:59.537999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:59.538698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:59.555173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.556572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.557264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.558850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.559470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.560143 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.092054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:00.112957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4a674fad-7710-443f-8760-4880310fbfc1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.578943 Aug 30 04:28:00.120455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 121/237] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:59 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:00.430146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:00.431997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: 48e41893-a6f9-419c-a450-9b8233aff17f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:00.440836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:00.441400 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:00.444316 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.446549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:00.447034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:00.447473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.467478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] HTTP exception thrown: Instance 48e41893-a6f9-419c-a450-9b8233aff17f could not be found. Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Request method failure captured: Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f HTTP/1.1 Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZG1MlHjcljoE7tamAEfvvvxfe8KwEJiP5pYEJBubH_HL_bIvX1Jyw8verBn6fLwamMhbMN3H17wU4AblsjSFYLzEzHfEEZUrjskn0VoO9FP_K0Ska3jxiUVV-eCPzGPgA8xLPoKyglEieWFXhxtkJ4DR8MKl6wS6-uotp_9kxFIzQE Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: bdbf61cc87384ade8eb07b032bb6292b Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesActionsTest-967137002 Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:28:00.469198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdbf61cc87384ade8eb07b032bb6292b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdbf61cc87384ade8eb07b032bb6292b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdbf61cc87384ade8eb07b032bb6292b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdbf61cc87384ade8eb07b032bb6292b"}]}] Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesActionsTest-967137002 Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: bdbf61cc87384ade8eb07b032bb6292b Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesActionsTest-967137002 Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesActionsTest-967137002-project Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 148a7e11786a4a54909c4a0679407b80 Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesActionsTest-967137002-project Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 48e41893-a6f9-419c-a450-9b8233aff17f could not be found. Aug 30 04:28:00.472422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '48e41893-a6f9-419c-a450-9b8233aff17f'} Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e41893-a6f9-419c-a450-9b8233aff17f could not be found. Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:00.473147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e41893-a6f9-419c-a450-9b8233aff17f could not be found. Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e41893-a6f9-419c-a450-9b8233aff17f could not be found. Aug 30 04:28:00.474308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:28:00.477432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Returning 404 to user: Instance 48e41893-a6f9-419c-a450-9b8233aff17f could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:00.478491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dbfa8c11-88e6-48df-bf6e-e5b8ad9a698a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f" status: 404 len: 111 microversion: 2.1 time: 0.054854 Aug 30 04:28:00.479623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 117/238] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:00 2022] GET /compute/v2.1/servers/48e41893-a6f9-419c-a450-9b8233aff17f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:00.669802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1818069436", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "networks": [{"uuid": "5b04d9ed-8f32-46c9-8e1b-21119d73cac4"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:01.146849 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:01.147795 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:01.155308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.155714 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.156198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.158035 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.159664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.160857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.680415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:01.712189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bb47d783-5dd2-40e8-8cf9-b81874b7e486 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.569472 Aug 30 04:28:01.713395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 118/239] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:01 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:02.928488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b2178982-f598-49fe-a6d1-36adbe0c68fa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'create', calling method: .version_select at 0x7fcda827a940>, body: {"keypair": {"name": "tempest-keypair-1190946743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpPXpdTvvdPJyidhqy5l2hz1uGeeQb2w2wyVKDZ121sm4jWrVHIwtSgfmVMSlFWGTr8gcP8jD15UGlARYLmiA9QiKvHqfpSj7Dpo+nP0QQ0wAy/igNxMu/d05+VIOS6/A=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:03.025528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-b2178982-f598-49fe-a6d1-36adbe0c68fa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:03.036833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-b2178982-f598-49fe-a6d1-36adbe0c68fa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for user b05dcf62adc949c79b37c92bb3e09e8e and project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:03.138974 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b2178982-f598-49fe-a6d1-36adbe0c68fa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.513579 Aug 30 04:28:03.139832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 119/240] 10.222.0.85 () {62 vars in 1200 bytes} [Tue Aug 30 04:28:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 523 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:28:03.150453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:03.153751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:03.170755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:03.171368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:03.172507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:03.173596 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:03.174328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:03.174852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:03.701380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:03.718746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ae510081-eb51-401a-973d-6c9924e43e98 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.577733 Aug 30 04:28:03.722053 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 120/241] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:03 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:04.744505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:04.746357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:04.756402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.757196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.758554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.762429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.763001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.763522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:05.050909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:05.062412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-82618be3-e143-46ff-933c-e221a7924bef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.323917 Aug 30 04:28:05.063681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 121/242] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:04 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:05.995370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-958204744", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a833cc4-0338-4d6e-b00c-99c3817ea5ba"}], "security_groups": [{"name": "tempest-securitygroup--1155934834"}], "key_name": "tempest-keypair-1190946743", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:07.990384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] validate_networks() for [('5b04d9ed-8f32-46c9-8e1b-21119d73cac4', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:28:08.486129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:08.486544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:08.487057 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:08.487464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:08.487916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:08.510545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.512231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.512694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.515179 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.515688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.518241 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.553601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Getting quotas for project bdbf61cc87384ade8eb07b032bb6292b. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:08.562091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Getting quotas for user 148a7e11786a4a54909c4a0679407b80 and project bdbf61cc87384ade8eb07b032bb6292b. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:08.574827 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:08.577617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:08.656885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-88217202-9c41-4b70-bccd-1f396dc26f84 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.991652 Aug 30 04:28:08.663678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 122/243] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 7998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:28:08.670794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:08.671699 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:08.680711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.681556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.682103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.683378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.683995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.684529 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:09.026082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:09.040271 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-10570350-8b4b-483c-9ca1-9484e121a35b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.377399 Aug 30 04:28:09.053685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 123/244] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:08 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:09.067860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f4c0d709-e931-4025-93d1-a3637bb7bd0f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:09.068548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f4c0d709-e931-4025-93d1-a3637bb7bd0f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:09.241666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f4c0d709-e931-4025-93d1-a3637bb7bd0f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:09.267408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f4c0d709-e931-4025-93d1-a3637bb7bd0f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1214 microversion: 2.1 time: 0.217163 Aug 30 04:28:09.277809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 124/245] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:09 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:09.494581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] validate_networks() for [('3a833cc4-0338-4d6e-b00c-99c3817ea5ba', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:28:10.064102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:10.065012 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:10.079454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.079951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.080387 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.092036 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.092575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.093030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.124276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:10.506253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:10.521021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-88659cca-b766-4890-8001-360a8865b47a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.459858 Aug 30 04:28:10.521859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 125/246] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:10 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:10.527325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:10.530732 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:10.543434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.549084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.549668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.550458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.551129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.552741 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.676084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:10.692505 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b9d7b513-95f7-4a7c-9c85-e24319d01c2a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1210 microversion: 2.1 time: 0.169471 Aug 30 04:28:10.700308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 126/247] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:10 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:10.851394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:10.851973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:10.853203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:10.853869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:10.857253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:10.869600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.870522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.871179 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.872261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.873312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.873979 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.900438 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:10.905836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for user b05dcf62adc949c79b37c92bb3e09e8e and project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:10.919162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:10.923371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:10.997016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f4a9f362-10d1-4be2-a716-3097aad5268b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.006235 Aug 30 04:28:10.998001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 122/248] 10.222.0.85 () {62 vars in 1188 bytes} [Tue Aug 30 04:28:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 5008 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:28:11.012169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-04561d82-254b-4e0f-bb0e-76d9a975980d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:11.013860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-04561d82-254b-4e0f-bb0e-76d9a975980d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:11.155664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-04561d82-254b-4e0f-bb0e-76d9a975980d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:11.167108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-04561d82-254b-4e0f-bb0e-76d9a975980d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:11.171006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-04561d82-254b-4e0f-bb0e-76d9a975980d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:11.174238 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-04561d82-254b-4e0f-bb0e-76d9a975980d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1281 microversion: 2.20 time: 0.167771 Aug 30 04:28:11.177286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 127/249] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:11 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:11.544393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:11.552013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:11.566506 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.567447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.568096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.569699 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.570689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.571013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.579332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:11.723235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:11.724148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:11.733490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.735818 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.736580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.757921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.758108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.759402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.989169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:12.011325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2c2b6c8c-9208-4999-be9d-a3f876f74bda tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1266 microversion: 2.1 time: 0.294017 Aug 30 04:28:12.011579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 128/250] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:11 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:12.012888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:12.022057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-81d2eed3-a3e8-4678-8947-f596293aa534 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1521 microversion: 2.1 time: 0.481606 Aug 30 04:28:12.036751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 123/251] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:11 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:12.207964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:12.210027 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:12.229480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.230287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.230915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.231816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.232445 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.233305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.319344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:12.330162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:12.331695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:12.332962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-90c92d77-cc2a-4d64-bf3a-9dd984b44cf3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1285 microversion: 2.20 time: 0.132436 Aug 30 04:28:12.333882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 129/252] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:12 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:13.032269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:13.034011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:13.041591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.042362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.043379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.043529 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:13.043985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:13.046098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.047555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.048729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.062873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.063618 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.065141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.066027 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.066635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.067210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.183377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.191892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f6d530d4-40ca-4ec8-849b-5c6c0451b703 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1266 microversion: 2.1 time: 0.164029 Aug 30 04:28:13.209620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 124/253] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:13 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:13.304218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.315461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a88d4022-f8c3-4a5b-8552-2cb6eec01d77 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1501 microversion: 2.1 time: 0.276048 Aug 30 04:28:13.316203 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 130/254] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:13 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1501 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:13.338039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:13.338652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:13.346133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.346617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.347234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.347982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.349142 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.349142 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.360534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:13.361585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:13.370204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.370957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.371570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.373344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.375002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.375002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.507482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.549941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.560343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.562274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-afe41e65-d00a-41fc-8c96-3454f6869fd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1277 microversion: 2.20 time: 0.211326 Aug 30 04:28:13.564398 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 131/255] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:13 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:13.631333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.643637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-29f6bf2c-e4ac-4b27-bc89-1584ee4ecc0d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1515 microversion: 2.1 time: 0.309495 Aug 30 04:28:13.644552 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 125/256] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:13 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:14.216455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:14.217085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:14.225813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.226444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.227119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.228074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.228758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.229570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.400346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:14.416929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-29181ffe-1a57-4d3f-8a51-339787980561 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1274 microversion: 2.1 time: 0.203970 Aug 30 04:28:14.418951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 132/257] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:14 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:14.595247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:14.596041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:14.602458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.603182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.604126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.605216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.606140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.606562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.723529 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:14.727069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:14.728744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:14.730007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-63a8cfe6-bbfa-40bf-adb3-ddceb8dda7b6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1333 microversion: 2.20 time: 0.138592 Aug 30 04:28:14.745716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 126/258] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:14 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1333 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:15.302349 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:15.305518 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.313716 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.314619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.315430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.316380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.317218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.317855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.355078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'flavor' on Instance uuid f359fb4c-9bdc-4898-81b0-26ea768f4444 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:28:15.439832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:15.440311 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.449970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.454080 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.454874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.455826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.456540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.457225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.523029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bb794556-8508-4e61-9f96-32e5240489fe tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/action" status: 200 len: 32 microversion: 2.1 time: 0.220513 Aug 30 04:28:15.524727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 133/259] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:28:15 2022] POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:28:15.546781 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:15.550245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.566806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.569841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.570468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.572218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.572954 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.575397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.849537 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:15.853279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:15.859493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-84c03660-c645-4546-aba4-7b618d1b54d4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.423457 Aug 30 04:28:15.863380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-40c19d2f-eb75-4338-ad82-c1fe807b1129 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.331057 Aug 30 04:28:15.864029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 127/260] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:15 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:15.864983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 134/261] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:15 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:15.869024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:15.869825 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.877870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.878642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.891545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.895501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.896128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.896701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.048370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:16.070227 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:16.075594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:16.085793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-748629d1-451f-4f12-8d9b-532f3abf8ee5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1339 microversion: 2.20 time: 0.220695 Aug 30 04:28:16.104100 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 128/262] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:15 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:16.905435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:16.906190 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:16.910307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:16.915804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:16.949842 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.954700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.955571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.956254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.959166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.960425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.962395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.964041 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.964753 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.965960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.972915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.976749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.426669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:17.440049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-36080da0-75fd-4978-aedb-7c9a346c582f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.544494 Aug 30 04:28:17.445386 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:17.459616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 129/263] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:16 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:17.462344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68cc970b-41db-4ff8-ac52-f7d5645a995f tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.569773 Aug 30 04:28:17.481060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 135/264] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:16 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:17.481289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-e455f64d-803a-4bee-a8ba-aa2756be6422 req-3bc01e82-492b-488d-a38b-767110f9709c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5571ed9-9e05-4ace-8641-f598d247960a", "tag": "9bb909ce-9d58-4d61-a46f-d9e132bf03a8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:17.494564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-e455f64d-803a-4bee-a8ba-aa2756be6422 req-3bc01e82-492b-488d-a38b-767110f9709c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.494775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:17.495050 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-e455f64d-803a-4bee-a8ba-aa2756be6422 req-3bc01e82-492b-488d-a38b-767110f9709c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.495557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-e455f64d-803a-4bee-a8ba-aa2756be6422 req-3bc01e82-492b-488d-a38b-767110f9709c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.495730 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:17.509177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-e455f64d-803a-4bee-a8ba-aa2756be6422 req-3bc01e82-492b-488d-a38b-767110f9709c service nova] Creating event network-changed:9bb909ce-9d58-4d61-a46f-d9e132bf03a8 for instance a5571ed9-9e05-4ace-8641-f598d247960a on hv-cinder-85426 Aug 30 04:28:17.517569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-e455f64d-803a-4bee-a8ba-aa2756be6422 req-3bc01e82-492b-488d-a38b-767110f9709c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055623 Aug 30 04:28:17.519713 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 130/265] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:17.523355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.524081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.524748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.527109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.527911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.528940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.954343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:17.963921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:17.965709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:17.967000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5d729510-c038-4a7e-9f2c-fba99ba2e6d9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.494045 Aug 30 04:28:17.967710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 136/266] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:17 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:18.226246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-0f1a5ec8-8d00-462a-9c39-d7994378e4da req-346f1df0-45c4-49ba-8bae-b7233e01f647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:18.237086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0f1a5ec8-8d00-462a-9c39-d7994378e4da req-346f1df0-45c4-49ba-8bae-b7233e01f647 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.238843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0f1a5ec8-8d00-462a-9c39-d7994378e4da req-346f1df0-45c4-49ba-8bae-b7233e01f647 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.239678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0f1a5ec8-8d00-462a-9c39-d7994378e4da req-346f1df0-45c4-49ba-8bae-b7233e01f647 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.256094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-0f1a5ec8-8d00-462a-9c39-d7994378e4da req-346f1df0-45c4-49ba-8bae-b7233e01f647 service nova] Creating event network-changed:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:28:18.262065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-0f1a5ec8-8d00-462a-9c39-d7994378e4da req-346f1df0-45c4-49ba-8bae-b7233e01f647 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039778 Aug 30 04:28:18.263229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 131/267] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:18.466820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:18.469590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:18.490073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.490573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.491386 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.492178 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.492705 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.495803 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:18.496499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.496672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:18.506762 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.510920 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.512221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.516701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.517435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.518094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.534055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:19.054445 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.063868 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e0941dc-96a3-4fbf-9c2f-4a171199667d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.605122 Aug 30 04:28:19.079363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 137/268] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:18 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:19.088951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:19.090078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:19.096368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.096864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.097676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.111520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ca2d7fb9-c278-4808-bf48-476637509b0a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.620588 Aug 30 04:28:19.115891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.120686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 132/269] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:18 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:19.123737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.126530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.127623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.382541 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.390859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.392523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.393850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dda9bb7c-4447-4b7d-8658-b8e8643133cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.313285 Aug 30 04:28:19.409474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 138/270] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:19 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:20.101073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.103613 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.121007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.121885 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.122601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.124593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.125575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.133013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.134422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.141637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.147080 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.151121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.151580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.152318 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.152765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.153212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.437457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:20.443521 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:20.457575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8842a3b4-3884-4ff1-8117-6d9b76d07c4d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.371945 Aug 30 04:28:20.470858 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07e0f20c-9f03-4647-b795-a310c1fb6c68 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.341860 Aug 30 04:28:20.473325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 139/271] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:20.474793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 133/272] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:20.478157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.478751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.486881 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.487629 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.488191 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.489029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.489820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.490380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.633274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:20.636739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:20.642675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:20.644110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:20.645278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4fe9b4bc-ac55-4429-8e99-1b2c7587b9da tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.170945 Aug 30 04:28:20.660988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 140/273] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:21.308473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ed578fb-1149-4c0e-b723-5ec900f254fd", "device": "/dev/sdb"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:21.311431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.314662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:21.315543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=10 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:21.319135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.320082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.320689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.322294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.322838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.323497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.479672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.480873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.483550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=10 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:21.490032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.490728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.491163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.491865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.492320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.493105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.660976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.669681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0090d234-7db2-40c1-9ba7-c04719f47a26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.193804 Aug 30 04:28:21.670397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 141/274] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:21.674614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-98878767-bbbe-497c-8edf-8f65ac1ce3c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "POST /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369899 Aug 30 04:28:21.680315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 134/275] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:28:21 2022] POST /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:21.680315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d551f0f9-5483-489b-b563-cf9387723c86 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Action: 'create', calling method: .version_select at 0x7fcda82c28b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-523824039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB87BELX+gJP6yhwIC5pVCH8MhmGekYHcuffdpf2GBlhIUOnVE5fsuDGt1TCdRCsP1sudJUb9Fs/fKusnrSaqUH13dVeVyM4GuyHEF0QL5ytnSjb/pky/KdytZFG+NQStA=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:21.686555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:21.688362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.689130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.697499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.698205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.698878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.699755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-d551f0f9-5483-489b-b563-cf9387723c86 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Getting quotas for project 3a706ffd11144f46ba54becd86464f02. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:21.699978 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.700755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.701435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.704573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-d551f0f9-5483-489b-b563-cf9387723c86 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Getting quotas for user 5d732bd750a54d8cb516fd5756d64936 and project 3a706ffd11144f46ba54becd86464f02. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:21.728916 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d551f0f9-5483-489b-b563-cf9387723c86 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052425 Aug 30 04:28:21.729543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 135/276] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:28:21 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:21.734257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.735155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.742636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.743323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.743757 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.744450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.744898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.745414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.894202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.902015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c6bcfe6f-ecff-4a10-91b4-ba80e58e9987 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.217901 Aug 30 04:28:21.902662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 142/277] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:21.912723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1839469363", "imageRef": "8cfad31f-2dd0-4794-bd72-1ec40c08fbd7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-523824039", "networks": [{"uuid": "96c8b8cf-2777-48ff-a669-0d5f521159b4"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:21.929669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.939035 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.940491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.941639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c55a0b0f-df7e-4935-90b7-839cf476f919 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.211040 Aug 30 04:28:21.942191 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 136/278] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:21.964480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] validate_networks() for [('96c8b8cf-2777-48ff-a669-0d5f521159b4', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:28:22.384407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:22.384948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:22.386075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:22.386075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:22.386497 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:22.399639 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.400137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.400577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.401442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.401901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.402328 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.429153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Getting quotas for project 3a706ffd11144f46ba54becd86464f02. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:22.433539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Getting quotas for user 5d732bd750a54d8cb516fd5756d64936 and project 3a706ffd11144f46ba54becd86464f02. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:22.445799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:22.448053 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cfad31f-2dd0-4794-bd72-1ec40c08fbd7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:22.499977 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-26887cda-ca5e-4f75-aac3-2c66c13004c9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595565 Aug 30 04:28:22.500844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 143/279] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:28:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:28:22.511388 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-289d5f67-9571-467a-8473-f072645b9155 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.512671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-289d5f67-9571-467a-8473-f072645b9155 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.567700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-289d5f67-9571-467a-8473-f072645b9155 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:22.575497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-289d5f67-9571-467a-8473-f072645b9155 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1258 microversion: 2.1 time: 0.067870 Aug 30 04:28:22.576093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 137/280] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:22.691089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.691701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.698708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.698708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.699146 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.699838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.700290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.700715 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.852029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:22.860723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8fd5fb70-46c1-4ee7-831b-1829b53b06ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.173617 Aug 30 04:28:22.861337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 144/281] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:22.922592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.923204 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.929912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.930483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.930921 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.931780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.932237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.932740 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.967568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.968251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.974992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.975485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.975956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.976845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.977246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.977671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.126464 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.134160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-197add02-2725-4f29-97e4-888a4f6db9f8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.215423 Aug 30 04:28:23.134732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 138/282] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:23.155965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.163926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.165397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.166502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-92c51c5f-47cd-43f9-bd3e-5cce52db73fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.204377 Aug 30 04:28:23.167056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 145/283] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:23.596622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:23.597264 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:23.603089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.603573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.604012 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.604701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.605180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.605604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.676145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.683816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d8cbc1db-dff3-4e97-b0f3-0afde89dbdcd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1262 microversion: 2.1 time: 0.091645 Aug 30 04:28:23.684547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 139/284] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:23 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:23.885457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:23.886160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:23.893486 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.893966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.894392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.895072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.895515 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.895934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.024765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.033024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-549d29b3-9465-4be5-97ea-5cadb8fbadf7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.151487 Aug 30 04:28:24.033595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 146/285] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:23 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:24.155034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:24.155656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:24.162411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.162896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.163330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.164029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.164479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.164899 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.189606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:24.190368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:24.196361 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.197026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.197493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.198332 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.198786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.199206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.347587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.355164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2b470ab0-4605-4980-998c-bd851ee62c95 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.204026 Aug 30 04:28:24.355740 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 140/286] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:24 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:24.370507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.379651 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.381295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.382431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-20217f91-f739-4a10-825a-0e6ba0327562 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.197317 Aug 30 04:28:24.382990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 147/287] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:24 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:24.703814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:24.704423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:24.710345 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.710823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.711253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.711929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.712377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.712793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.774320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.776455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:24.783294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-723ef470-dc2b-4e59-86e9-37d22c457ab8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1262 microversion: 2.1 time: 0.083257 Aug 30 04:28:24.783852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 141/288] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:24 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:25.054094 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:25.054707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:25.056997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:25.062292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.062793 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.063227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.063910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.064363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.064787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.197842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.206015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-852abda5-6475-4b5f-a1de-ae715f409d2d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.155764 Aug 30 04:28:25.206574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 148/289] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:25 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:25.375715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:25.376327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:25.383888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.384374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.384808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.385531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.385982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.386439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.405251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:25.405882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:25.412295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.412777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.413259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.413947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.414399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.414821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.583489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.591325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.591598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-69d180eb-e352-45a9-af2f-ad052a769734 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.219749 Aug 30 04:28:25.592188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 142/290] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:25 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:25.599465 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.600984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.602172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d669869e-ec84-44e0-b91c-ca1bb29d340b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.200929 Aug 30 04:28:25.602789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 149/291] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:25 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:25.804013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:25.804636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:25.810769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.811259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.811698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.812402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.813386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.813809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.879291 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.886868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0de7f45f-c9a3-4989-a80f-bbd9d75023e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1262 microversion: 2.1 time: 0.087061 Aug 30 04:28:25.887432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 143/292] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:25 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:26.227250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.227764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.234147 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.235116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.235544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.236222 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.236665 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.237108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.366929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.374796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3a91c805-e499-4e6e-99a3-3eb77a500476 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.151471 Aug 30 04:28:26.375350 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 150/293] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:26.612106 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.612714 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.619772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.620258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.620803 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.621520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.621968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.622390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.623696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.624310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.630148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.630633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.631070 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.631760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.632216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.632638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.814219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.822919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89e45ecf-18ca-475c-96bc-84f87a213f51 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.215118 Aug 30 04:28:26.823814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 144/294] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:26.831389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.839351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.840789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.841916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-08a9d8e6-2ad6-40cf-9449-b0e9e20ff933 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.222019 Aug 30 04:28:26.842468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 151/295] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:26.908553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.909197 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.915180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.915816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.916280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.916988 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.917467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.917945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.979057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.986737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1765bfa-ba5c-4176-bc50-432ddf4a0235 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1262 microversion: 2.1 time: 0.082667 Aug 30 04:28:26.987302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 145/296] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:27.396111 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:27.396733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:27.403140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.403621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.404049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.404729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.405219 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.405634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.536159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:27.543764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5636f753-91da-41ed-95b6-087de560056a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.152270 Aug 30 04:28:27.544419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 152/297] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:27 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:27.843833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:27.844450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:27.851498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.851981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.852417 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.853136 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.853591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.854013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.864251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:27.864846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:27.870987 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.871474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.871904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.872587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.873062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.873487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.057429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.060809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.069159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-59dcf11f-2b28-440e-b930-68741b9716eb tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.228632 Aug 30 04:28:28.069667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 146/298] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:27 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:28.074151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:28.074759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:28.080742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.081267 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.081698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.081892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.082389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.082838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.083254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.083429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.084818 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bedc4c67-22c0-4243-9e65-e03fe2ae2ea6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.224736 Aug 30 04:28:28.085810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 153/299] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:27 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:28.172778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.181149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ddfa157b-61c8-4851-9658-526bb2c9c33e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1262 microversion: 2.1 time: 0.110451 Aug 30 04:28:28.181705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 147/300] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:28 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1262 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:28.566072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:28.566677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:28.573101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.573588 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.574019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.574703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.575157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.575581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.704986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.712530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5cfbdeea-3007-4d23-a0bf-fe6bf3213b26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.150334 Aug 30 04:28:28.713515 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 154/301] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:28 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:29.093658 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:29.094195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:29.102592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.102592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.102592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.103013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.103453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.103882 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.109324 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:29.110212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:29.118911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.119652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.120298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.123559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.124034 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.124469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.298797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.306546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e04a7546-3b2d-4fe7-b331-9ccb4022265e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.217026 Aug 30 04:28:29.307120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 148/302] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:29 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:29.311694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:29.312304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:29.318017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.318502 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.319188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.320034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.320491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.320958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.324593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.332554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.334026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.335122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c2d3ad69-9c2b-4fb6-a0dc-19e972086a56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.230801 Aug 30 04:28:29.335679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 155/303] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:29 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:29.381314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.388894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a0af74aa-8b62-4e60-8035-b9217183e0df tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1262 microversion: 2.1 time: 0.080810 Aug 30 04:28:29.389493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 149/304] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:29 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:29.734770 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:29.735565 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:29.742315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.743063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.743494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.744198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.744645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.745085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.877335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.884799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f23b329b-1b11-4b36-886f-e98f1a1c2fdb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.153901 Aug 30 04:28:29.885379 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 156/305] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:29 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:30.327930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.328531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.337201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.337691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.338128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.338824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.339281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.339701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.357449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.358216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.364543 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.365175 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.365605 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.366287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.366724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.367135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.552123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.555985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.561900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-beb369c9-076e-475e-9a87-e6adb1b1ff7e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.237925 Aug 30 04:28:30.562998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 150/306] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:30.566145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.567937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.569110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.569512 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fe9d5fd6-608d-4422-9ff4-8c7d3d859f58 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.215609 Aug 30 04:28:30.569728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.575613 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.576279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.576873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.577771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.578384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.578964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.585507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 157/307] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:30.648361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.655895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9538ea51-18e4-4bfb-89f9-7dcc8691e1c6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1310 microversion: 2.1 time: 0.091635 Aug 30 04:28:30.656457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 151/308] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:30.671546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-48738452-ad2c-48cf-9617-5e8962050ee5 req-b7595e5a-75fe-4069-9bf6-5f5dc90b889c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "name": "network-vif-plugged", "status": "completed", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:30.682071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48738452-ad2c-48cf-9617-5e8962050ee5 req-b7595e5a-75fe-4069-9bf6-5f5dc90b889c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.682393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48738452-ad2c-48cf-9617-5e8962050ee5 req-b7595e5a-75fe-4069-9bf6-5f5dc90b889c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.682812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48738452-ad2c-48cf-9617-5e8962050ee5 req-b7595e5a-75fe-4069-9bf6-5f5dc90b889c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.686695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:30.695313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-48738452-ad2c-48cf-9617-5e8962050ee5 req-b7595e5a-75fe-4069-9bf6-5f5dc90b889c service nova] Creating event network-vif-plugged:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:28:30.700230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-48738452-ad2c-48cf-9617-5e8962050ee5 req-b7595e5a-75fe-4069-9bf6-5f5dc90b889c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Aug 30 04:28:30.700807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 158/309] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:30.906076 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.906682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.913014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.913518 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.913945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.914621 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.915068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.915483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.182270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.190122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-478145a9-e4c4-486a-82ab-f394f2a86f6d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.287856 Aug 30 04:28:31.190677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 152/310] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:31.585488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.588935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.592045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.593433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.595547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.596038 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.596514 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.597219 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.597727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.598543 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.602144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.602782 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.603309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.604154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.605163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.605940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.868255 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.880173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.888421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.890039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f205183b-d9d4-4ed7-aa2d-03c05a893d7d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.310564 Aug 30 04:28:31.890158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.899527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 159/311] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:31.899717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8bb83d3e-a8d4-4d8d-ac6f-58ecb3921747 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.303540 Aug 30 04:28:31.899717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 153/312] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:31.906375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.907240 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.913667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.914150 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.914588 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.915275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.915727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.916145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.187537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:32.195756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4028899d-429c-4d7b-9928-16147d3eb002 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1316 microversion: 2.1 time: 0.303653 Aug 30 04:28:32.196308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 160/313] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:32.210924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:32.211534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:32.217328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.217840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.218271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.219010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.219462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.219890 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.447953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:32.455595 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7f39a842-b9cf-471b-b6b7-1a9e99ea02ad tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.248490 Aug 30 04:28:32.456211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 154/314] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:32 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:32.910171 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:32.911421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:32.917156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:32.917630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:32.917809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:32.917911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:32.919722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:32.925955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.926269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.926438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.926791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.927045 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.927669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.927797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.928173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.928374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.928589 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.928818 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.933622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.125536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.133362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.134424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.135927 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.137215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce170e52-7ff6-4a67-bf79-c9211344f745 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.226293 Aug 30 04:28:33.144404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fbb47de8-0578-46ed-9b82-682d045834f5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.235201 Aug 30 04:28:33.145588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 155/315] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:32 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:33.158568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 161/316] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:32 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:33.215484 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:33.216095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:33.222747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.223231 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.223662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.224344 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.224882 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.225327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.476870 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:33.478720 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:33.486200 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.494245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.496789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.501780 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.502446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.504213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.507368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.519243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d9122040-ce23-4a72-924b-a6d367f49ec6 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.307274 Aug 30 04:28:33.521874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 156/317] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:33 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:34.017796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.017796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a27e0451-dc4f-4b17-909c-38d5dc6db4da tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.540831 Aug 30 04:28:34.027784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 162/318] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:33 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:34.160297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:34.161209 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:34.166284 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:34.166899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:34.168339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.168780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.169340 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.170245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.170698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.171578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.177393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.177894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.178330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.181180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.181819 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.182249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.418247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.451565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.456508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.458056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.459997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c117b228-619b-4459-87fa-7bb735e2da04 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.304130 Aug 30 04:28:34.462200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 157/319] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:34 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:34.468792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a05632f3-8bb3-4144-a2f5-1e97cf5870c8 req-d0306ce3-808e-4fdb-bf1d-be9668af88f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:34.482002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3d9b852b-9e42-4275-86d6-3d16fa6180e7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.319369 Aug 30 04:28:34.482583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 163/320] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:34 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:34.487151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a05632f3-8bb3-4144-a2f5-1e97cf5870c8 req-d0306ce3-808e-4fdb-bf1d-be9668af88f0 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.487744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a05632f3-8bb3-4144-a2f5-1e97cf5870c8 req-d0306ce3-808e-4fdb-bf1d-be9668af88f0 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.488653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a05632f3-8bb3-4144-a2f5-1e97cf5870c8 req-d0306ce3-808e-4fdb-bf1d-be9668af88f0 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.507154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a05632f3-8bb3-4144-a2f5-1e97cf5870c8 req-d0306ce3-808e-4fdb-bf1d-be9668af88f0 service nova] Creating event network-changed:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:28:34.512719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a05632f3-8bb3-4144-a2f5-1e97cf5870c8 req-d0306ce3-808e-4fdb-bf1d-be9668af88f0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048477 Aug 30 04:28:34.513470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 158/321] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:34.548662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:34.549322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:34.555896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.569278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.570033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.570962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.571432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.571864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.727529 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.736704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-de8f603f-0bb5-4d83-84fb-8b899cd8e5ad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.192579 Aug 30 04:28:34.749868 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 164/322] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:34 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:35.034545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:35.035241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:35.041273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.041756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.042188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.043134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.043311 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.043732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.047699 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:35.185361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.193600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-86c0457c-c3a4-4f4a-a06e-47511f68145b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.163182 Aug 30 04:28:35.194166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 159/323] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:35 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:35.421706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-62cd5560-4244-4b9f-a1cb-1f3f8a040f79 req-707f2df0-8f43-4167-b08a-9879aef88e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5571ed9-9e05-4ace-8641-f598d247960a", "name": "network-vif-plugged", "status": "completed", "tag": "9bb909ce-9d58-4d61-a46f-d9e132bf03a8"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:35.432139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-62cd5560-4244-4b9f-a1cb-1f3f8a040f79 req-707f2df0-8f43-4167-b08a-9879aef88e29 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.432625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-62cd5560-4244-4b9f-a1cb-1f3f8a040f79 req-707f2df0-8f43-4167-b08a-9879aef88e29 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.433062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-62cd5560-4244-4b9f-a1cb-1f3f8a040f79 req-707f2df0-8f43-4167-b08a-9879aef88e29 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.444824 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-62cd5560-4244-4b9f-a1cb-1f3f8a040f79 req-707f2df0-8f43-4167-b08a-9879aef88e29 service nova] Creating event network-vif-plugged:9bb909ce-9d58-4d61-a46f-d9e132bf03a8 for instance a5571ed9-9e05-4ace-8641-f598d247960a on hv-cinder-85426 Aug 30 04:28:35.450257 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-62cd5560-4244-4b9f-a1cb-1f3f8a040f79 req-707f2df0-8f43-4167-b08a-9879aef88e29 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031918 Aug 30 04:28:35.450744 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 165/324] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:35.487283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:35.487937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:35.494344 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.494834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.495270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.495971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.496660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.505920 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:35.507239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:35.507439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.516394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.517129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.517663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.518465 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.519019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.519581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.719151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.723586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.728276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5a6606fb-ddb3-4d5f-abb1-fb8a0cc19ebe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.228807 Aug 30 04:28:35.729009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 166/325] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:35 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:35.749254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.749254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.749254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-74d83092-7478-426b-8b12-c6b6576154ea tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.263093 Aug 30 04:28:35.749556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 160/326] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:35 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:35.770602 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:35.771499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:35.777888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.778646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.779084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.779777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:35.780227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:35.780876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.913738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.921270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-605951ae-2c16-4619-bc29-78f76d77667d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.154812 Aug 30 04:28:35.921825 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 167/327] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:35 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:36.214972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.216494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.224221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.225058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.225660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.226837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.227453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.228097 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.360914 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.369592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b3aa8643-6c89-4703-aa21-9d312c22668a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.158343 Aug 30 04:28:36.370132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 161/328] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:36.753117 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.756525 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.763323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.763840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.764273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.764965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.765453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.765875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.774381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.775072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.781267 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.781913 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.782458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.783331 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.783786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.784202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.973463 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.977901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.981929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5e04cd99-2d63-43f6-85f8-1dd029eb1546 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.234514 Aug 30 04:28:36.982566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 168/329] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:36.987520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.988261 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.988866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.989306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.990562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d444b4f8-db65-487e-aa4c-babd5c8b0994 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.220621 Aug 30 04:28:36.991209 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 162/330] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:36.997887 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.998371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.998801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.999486 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.999940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:37.000357 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:37.138879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:37.159392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fa8ae70c-0da3-476a-a0b5-fc184d1ce1bd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.175601 Aug 30 04:28:37.160293 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 169/331] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:37.390616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:37.391138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:37.397668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:37.398157 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:37.398590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:37.399276 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:37.399737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:37.400156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:37.533389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:37.542446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-36861d53-bde7-4252-ba3b-47786ae25c9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.155669 Aug 30 04:28:37.543107 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 163/332] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:37 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:38.003648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.004286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.010811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.011292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.011725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.012411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.012860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.013299 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.013415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.013960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.020928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.021449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.021878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.022565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.023010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.023422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.213865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.221605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.236217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0eaf8ec8-4e44-4d4a-8850-c46cdd07d4c5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.229667 Aug 30 04:28:38.236217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 170/333] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:37 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:38.236217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.236217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.239666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.240982 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.241210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.241517 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.241937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.242793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a4d68699-0e6f-4827-bf9e-bb39fa841239 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.233122 Aug 30 04:28:38.242919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.243322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.243423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 164/334] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:38 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:38.243735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.323183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.323542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.330262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.330751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.331240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.331968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.332451 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.332873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.363370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cb9d3b3c-f268-457e-bee4-f690543698f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/ips" status: 200 len: 144 microversion: 2.1 time: 0.043912 Aug 30 04:28:38.364391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 165/335] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:28:38 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:38.395299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.403065 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-26e2bc6d-4d10-4329-bfa5-81484ac333de tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.172482 Aug 30 04:28:38.403779 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 171/336] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:38 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:38.563823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.564426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.570816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.571296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.571723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.572399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.572841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.573288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.708773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.716429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d6756b1d-2af8-45fa-a3c9-c69d77fda6ae tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.156444 Aug 30 04:28:38.716989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 166/337] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:38 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:39.250390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:39.252374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:39.259632 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.260475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.261174 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.262245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.262917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.263552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.265816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:39.266433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:39.276953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.277476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.277910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.278612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.279076 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.280029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.463168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:39.471707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-15a5a176-fe1b-416d-b46f-be59a583ca4a tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.224988 Aug 30 04:28:39.472722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 172/338] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:39 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:39.475031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:39.480532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:39.481392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:39.483273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:39.484710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:39.486437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d512a12d-11cc-4d02-8d08-3f3fa138bd47 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.224405 Aug 30 04:28:39.486986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 167/339] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:39 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:39.488025 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.488509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.488937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.489635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.490084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.490611 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.623532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:39.631092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b6d95092-f0cf-44b3-90a2-153e4e5441c3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.154200 Aug 30 04:28:39.631670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 173/340] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:39 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:39.737867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:39.738486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:39.745111 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.745600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.746045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.746734 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.747192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.747614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.881213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:39.889115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-78dc9e99-55bd-4a2d-9d59-48bbd66da900 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.155724 Aug 30 04:28:39.889812 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 168/341] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:39 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:40.492691 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:40.493437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:40.500330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.501355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.501788 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.502488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.502930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.503343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.509379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:40.510217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:40.516239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.517393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.517872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.518700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.519161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.525156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.733082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.741501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.744203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.745721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.746869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c239edcf-017b-434b-beb4-3b2c7912eb54 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.241749 Aug 30 04:28:40.747426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 169/342] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:40 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:40.750384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9e43614d-4e97-4fa8-a824-59683caf782b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.261820 Aug 30 04:28:40.757140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 174/343] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:40 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:40.760823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:40.761704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:40.769437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.770014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.770457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.771169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.771683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.772114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.912314 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:40.913137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:40.919619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.920243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.920682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.921408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:40.921864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:40.922286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.930101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.939895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e434c1de-b00b-4e7b-99c8-29a30f7405c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.189441 Aug 30 04:28:40.940912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 170/344] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:40 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:41.097358 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.118360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ae98043f-7ab4-45c2-99b9-7c41281c3b1f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.207588 Aug 30 04:28:41.118995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 175/345] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:40 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:41.772254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:41.772854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:41.777214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:41.778054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:41.779640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.780127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.780556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.781263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.781715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.782151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.784830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.785435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.785904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.786596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.787053 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.787480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.791663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.980860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.983594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.989805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.991247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.991472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0d2db9f9-b9ca-4fa8-9129-3adaf07837ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.218310 Aug 30 04:28:41.992034 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 176/346] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:41 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:41.992603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8218e72a-27dc-422d-9298-94df4d6871df tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.224111 Aug 30 04:28:41.993314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 171/347] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:41 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:42.005586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:42.006291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:42.012098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.012604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.013061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.013756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.014206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.014622 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.140256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:42.141258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:42.147649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.148253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.148958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.149929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.150528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.151052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.154904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:42.165540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-71ad5d25-24a5-48bf-8af3-0739c96f63bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.171828 Aug 30 04:28:42.178288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 177/348] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:41 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:42.370449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:42.378761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-350a131b-5f33-4def-ad0c-c4caaeb64d09 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.242971 Aug 30 04:28:42.379321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 172/349] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:42 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:43.013220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:43.014046 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:43.014364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:43.014972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:43.021625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.021895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.022376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.022489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.022805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.023108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.023477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.023923 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.024035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.024336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.024618 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.025133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.239743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.248287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-342e42e1-f1e1-46b6-aeed-106ebf150e8e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.238922 Aug 30 04:28:43.248865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 178/350] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:43 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:43.261302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.262852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:43.263298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:43.263794 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.265284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.266545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-098c1643-d00a-44c3-adf7-0829ac9b45d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.256022 Aug 30 04:28:43.267764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 173/351] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:43 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:43.270709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.271278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.271784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.272559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.273125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.273615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.399990 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:43.400605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:43.406727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.407271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.407821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.408651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.409143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.409572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.421821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.430953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fc5f3126-47b6-46f1-bbe9-139140453192 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.181026 Aug 30 04:28:43.436382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 179/352] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:43 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:43.566823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.574728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bea2d2e5-6e06-46f9-8496-f1a462cdd522 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.178747 Aug 30 04:28:43.575304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 174/353] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:43 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:44.271063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.272290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.279982 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.280837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.281366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.282169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.282680 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.283174 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.292538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.293187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.300300 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.300790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.301358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.302117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.302578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.303059 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.512858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.514578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.523670 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.523792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2e40c3f7-d0a6-43a1-8c5a-2905cc8b3ca8 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.256812 Aug 30 04:28:44.524581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 180/354] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:44.524909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.526086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a884b559-4f61-4d12-918d-5909c678324b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.237446 Aug 30 04:28:44.530102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.530705 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.536956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.537566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.537992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.538728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.539162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.539575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.540569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 175/355] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:44.595873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.596401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.604798 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.605324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.606426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.607136 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.607585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.608805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.633069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:44.725776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.742910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5d9a1607-b707-492d-9383-ee3b35b589cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.216853 Aug 30 04:28:44.752535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 181/356] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:44.782605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.790268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-43fa2273-58a2-4b90-8595-c8dd2c45b801 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.198294 Aug 30 04:28:44.790826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 176/357] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:45.546101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.546766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.547448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.548064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.553462 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.553940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.554349 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.554455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.554841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.555037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.555278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.555488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.555905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.555997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.556416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.556846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.752850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.760167 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.764624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.766210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.768302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4c170c55-80d9-40b6-945f-f319e873c5f8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.224554 Aug 30 04:28:45.770043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bd8ce4fa-58bf-4748-89fd-6e8209542c4c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.227752 Aug 30 04:28:45.783109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 177/358] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:45.783616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 182/359] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:45.787230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.787847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.793879 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.794355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.794789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.795479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.795936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.796403 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.811498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.812873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.819643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.820159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.820620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.821331 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.821781 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.822197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.013171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.019893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.021060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1858bdf2-4b0e-420e-ba4f-763078ef07c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.238029 Aug 30 04:28:46.021624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 178/360] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:46.027624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a8ab5808-4b12-48c4-a6cd-cdb07e519277 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.220006 Aug 30 04:28:46.028178 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 183/361] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:46.791057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:46.791633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:46.791999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:46.792103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:46.798657 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:46.798869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.799452 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.799645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.800323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.800522 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.800812 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.801111 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.801281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.801582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.801984 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.802442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.802870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.012249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:47.015824 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:47.021720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:47.023358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:47.024589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-262b402d-5156-4b43-beb0-dc638e802c25 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.237757 Aug 30 04:28:47.025369 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 179/362] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:46 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:47.025489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cfe956f0-08ef-464f-bde4-284f2e2220e5 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.238041 Aug 30 04:28:47.025912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 184/363] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:46 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:47.044586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:47.045167 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:47.051262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:47.051423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.051819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.051935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:47.052255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.053044 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.053596 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.054043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.058460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.059254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.059701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.060490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.060948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.061572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.261449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:47.265732 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:47.269774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-90c2dd44-1ed4-49ed-bc02-423c3c8e08ae tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.229481 Aug 30 04:28:47.270351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 180/364] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:47 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:47.273887 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6baf523d-2faa-4646-b93c-707ca1a1d1ee tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.226386 Aug 30 04:28:47.274444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 185/365] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:47 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:48.046796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:48.047439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.052247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:48.053082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.054489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.055175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.055607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.057701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.058170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.058602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.059535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.060008 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.060430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.061210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.061652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.062064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.254211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.258146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.262646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a9a4201e-8de1-4d15-9fe7-eb14c0feef9c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.214936 Aug 30 04:28:48.263224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 186/366] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:48 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:48.266319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.267751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.268852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-21d36f36-2822-4b45-82a2-8e0ad5d8c606 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1407 microversion: 2.20 time: 0.225975 Aug 30 04:28:48.269424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 181/367] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:48 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:48.290256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:48.290866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.293821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:48.294507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.296698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.299501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.299501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.299501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.299501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.299814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.301003 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.301511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.301969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.302656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.303127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.303547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.689635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.693072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.698133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-41a40eeb-e344-4a4d-90e8-33e87a6066b9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.411834 Aug 30 04:28:48.698879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 187/368] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:48 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:48.703477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6e49d7b-a891-4b19-a519-dcdb856ebda0"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:48.706239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.707688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-180e5bf1-350d-487a-b15e-1d126604b6b0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.417449 Aug 30 04:28:48.708335 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 182/369] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:48 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:48.712097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.712577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.713009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.713813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.714260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.714713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.282440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.283047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.289758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.290238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.290665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.291352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.291797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.292210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.472992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.485934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-836c2f94-3e4e-4c62-97d5-0b533395911e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.207016 Aug 30 04:28:49.486867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 183/370] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:49.492024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.492884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.499079 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.499548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.500121 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.501473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.501918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.502365 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.649114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.657083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.658550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.659704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-06a502a2-8ad1-457b-9dc0-fd6bdb0dda5f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1599 microversion: 2.20 time: 0.171815 Aug 30 04:28:49.660257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 184/371] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:49.681508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.681996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.687588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.688731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.689219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.689905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.690352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.690773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.769715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-933f786d-5eef-4043-bf22-0adde938da32 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091750 Aug 30 04:28:49.770313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 185/372] 10.222.0.85 () {60 vars in 1316 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:28:49.774925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.775558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.781724 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.782251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.782681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.783376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.783827 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.784245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.911293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.919030 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-739e4fab-bc22-47ae-abba-8fd00e07116d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.147759 Aug 30 04:28:49.919604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 186/373] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:49.924548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.925216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.930892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.931383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.931818 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.932510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.932966 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.933683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.060130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:50.067989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a5757ac3-85e9-40ef-bb82-c616698f3123 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.147422 Aug 30 04:28:50.068556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 187/374] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:50.507888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.508516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.515442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.515919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.516348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.517031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.517502 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.517919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.666854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:50.675279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77689810-03a6-4436-b468-e9185a72121b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.171341 Aug 30 04:28:50.676040 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 188/375] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:50 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:50.727420 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-61d607ac-c9e2-497c-8bb3-90d7cac0afe1 req-c9853dda-186d-4990-a51f-238f95fc1fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:50.738355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-61d607ac-c9e2-497c-8bb3-90d7cac0afe1 req-c9853dda-186d-4990-a51f-238f95fc1fa9 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.739168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-61d607ac-c9e2-497c-8bb3-90d7cac0afe1 req-c9853dda-186d-4990-a51f-238f95fc1fa9 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.739888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-61d607ac-c9e2-497c-8bb3-90d7cac0afe1 req-c9853dda-186d-4990-a51f-238f95fc1fa9 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.771313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-61d607ac-c9e2-497c-8bb3-90d7cac0afe1 req-c9853dda-186d-4990-a51f-238f95fc1fa9 service nova] Creating event network-changed:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:28:50.785602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-61d607ac-c9e2-497c-8bb3-90d7cac0afe1 req-c9853dda-186d-4990-a51f-238f95fc1fa9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061034 Aug 30 04:28:50.786202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 189/376] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:50.941215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.942217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.955988 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.957161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.957161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.970738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.971528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.972247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.978927 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-37ffe8e3-10f4-493f-bd18-2770e759956a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.278927 Aug 30 04:28:51.013663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 188/377] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:28:48 2022] POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-volume_attachments => generated 194 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:51.090058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:51.090572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:51.114914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:51.115641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:51.116244 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.117415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:51.118021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:51.118599 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.349597 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.357489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f4e3db67-64c4-471b-89ca-83c1ac662a58 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.420799 Aug 30 04:28:51.367070 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.371089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 190/378] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:50 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:51.375556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8ee52c8b-9303-49ce-8470-d15d058ef840 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.289845 Aug 30 04:28:51.376196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 189/379] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:51 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:51.695972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:51.697249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:51.703258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:51.704475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:51.704911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.705644 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:51.706155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:51.706576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.842636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.850366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fc3e77b1-9ddc-47f7-aa39-f690552913d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.158597 Aug 30 04:28:51.850936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 191/380] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:51 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:52.378425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:52.379097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:52.385515 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.386000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.386433 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.387117 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.387571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.387997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.395547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:52.396191 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:52.402401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.402986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.403423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.404115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.404591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.405016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.576700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:52.584733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6eff1260-f58a-4490-a277-ebce4a15c450 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.210196 Aug 30 04:28:52.585312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 190/381] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:52 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:52.591066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:52.599280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-05a960bd-93ca-4af1-9fbf-b048d68774a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.207599 Aug 30 04:28:52.599836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 192/382] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:52 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:52.871783 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:52.872385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:52.878373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.878846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.879271 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.879941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.880385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.880822 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.898844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:53.012926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:53.021009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-65d874b6-7b22-4061-af81-96a7dc84069c tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.153041 Aug 30 04:28:53.021592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 191/383] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:52 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:53.604983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:53.605635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:53.612648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.613158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.613591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.614280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.614729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.615150 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.620757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:53.621397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:53.628409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.628890 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.629360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.630050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.630503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.630931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.811159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:53.812331 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:53.817231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:53.819508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2ff4658a-3889-4c6e-b201-badc6e7d5653 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.218288 Aug 30 04:28:53.820092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 193/384] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:53 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:53.824836 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-759931a4-0436-4066-9389-10d24503c10f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.208105 Aug 30 04:28:53.825422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 192/385] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:53 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:54.041504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.042074 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:54.048674 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.049186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.049623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.050312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.050771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.051194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.177890 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:54.185507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-63f4af1e-fdde-437a-863c-e6bb025d80b4 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.147963 Aug 30 04:28:54.186064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 194/386] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:54 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:54.840088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.840865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:54.846738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.847391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:54.848113 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.848732 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.849205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.849880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.850451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.850875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.853870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.854362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.854801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.855633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.856189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.856518 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.040641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.043691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.048327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-863a1e1f-bc80-4fc6-9e6e-4de733ef365c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.212100 Aug 30 04:28:55.048896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 193/387] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:54 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:55.051432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0994e35d-1711-44e2-8f88-92317256d1d4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.210141 Aug 30 04:28:55.051986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 195/388] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:54 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:55.206119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:55.206738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:55.208643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=92 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:55.214132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.214656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.215086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.215780 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.216237 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.216659 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.354530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.362950 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1dd5570e-7a7e-4a5f-a514-0a7346666e41 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.160655 Aug 30 04:28:55.363587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 194/389] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:55 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:56.069306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.069967 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.077408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.078131 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.078266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.079308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.079939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.080851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.081412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.081893 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.085624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.086098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.086521 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.087255 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.087704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.088299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.304414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.307570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.312329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c512d615-83dc-425f-8bc6-87189823ed26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.246913 Aug 30 04:28:56.313487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 196/390] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:56.315703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a457ae8a-c760-4456-b8a6-6ae5667d1347 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.241521 Aug 30 04:28:56.316252 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 195/391] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:56.382835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.383453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.389371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.389864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.390303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.391030 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.391486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.391956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.598125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.606369 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1da47ac-e242-4322-8733-7ca5748b46ba tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.227342 Aug 30 04:28:56.606942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 197/392] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:57.333602 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.334216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.335528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.336255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.342903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.343466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.344146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.345397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.345924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.346421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.351724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.352210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.352768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.353554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.354434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.354861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.556884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:57.559976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:57.565628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7afa1eef-44e2-4d0e-b2cc-5b01f51bfea0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.233934 Aug 30 04:28:57.566208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 198/393] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:57.568066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-81f85bde-24d7-433d-a06a-0602a6cc78d5 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.238224 Aug 30 04:28:57.568616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 196/394] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:57.627743 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.628345 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.634454 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.634877 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.635304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.635976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.636445 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.636858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.769388 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:57.776872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d6a10df9-9df3-48ea-bcf1-386181877a02 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.153295 Aug 30 04:28:57.777511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 199/395] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:58.586815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:58.587423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:58.588334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:58.588945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:58.594049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.594530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.594963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.595376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.595646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.595856 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.596095 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.596289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.596514 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.596977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.597468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.597888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.787393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.791294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.795366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-959c1a7f-8bf8-449d-9378-53f1e1072ab0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.212348 Aug 30 04:28:58.795947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 197/396] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:58 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:58.799554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a33ed5cb-c21e-4e31-8bcd-8ad8cc54951d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.214950 Aug 30 04:28:58.800392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 200/397] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:58 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:58.801061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:58.801733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:58.807567 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.808121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.808621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.809414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.809864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.810281 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.935590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.943697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-327fcb44-2989-4370-a602-4a1306ca239b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.146817 Aug 30 04:28:58.944248 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 198/398] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:58 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:59.816295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:59.816871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:59.820316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:59.820938 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:59.823439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.823951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.824393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.825251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.825720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.826150 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.827209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.827691 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.828129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.828812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.829290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.829717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.016826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.023100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.025331 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce9b44ba-8ccb-43fc-ad61-eafdfb4f7376 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.213013 Aug 30 04:29:00.025900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 201/399] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:59 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:00.030375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:00.030975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:00.031952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98e5dcdd-0263-4309-b54e-1fa5e982c48b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.214946 Aug 30 04:29:00.037294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:00.037772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:00.038197 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.038880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:00.039323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:00.040002 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.043760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 199/400] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:59 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:00.168192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.176236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-577f489f-ecd9-40d9-9baf-e941b383030e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1314 microversion: 2.1 time: 0.149394 Aug 30 04:29:00.176788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 202/401] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:00 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:01.046254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:01.047134 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:01.051868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:01.052225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:01.053926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.054415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.055124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.055836 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.056381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.056808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.058910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.059416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.059857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.060557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.061219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.061646 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.287427 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.290522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.296820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e557c712-6664-42ee-8594-387a39d162de tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.254341 Aug 30 04:29:01.297697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 200/402] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:01 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:01.302425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:01.303286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:01.310310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.311094 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.311755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.312524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.313567 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.313829 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-48bab4c8-8ab9-49db-8505-d9f9fd90716b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.265946 Aug 30 04:29:01.314135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.314423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 203/403] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:01 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:01.538022 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.546121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-69ed8683-3469-45ac-a386-d37e045a2401 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1498 microversion: 2.1 time: 0.247193 Aug 30 04:29:01.546694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 201/404] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:01 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1498 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:02.318658 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:02.319190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:02.325745 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.326235 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.326672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.327367 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.327819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.328250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.334205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:02.334814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:02.341149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.341625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.342058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.343300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.343300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.343616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.708550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:02.717366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3ecad895-fee1-4bea-8847-4410d94f1da1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.402582 Aug 30 04:29:02.717953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 204/405] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:02 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:02.719504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:02.729095 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-836673af-e11f-48f3-a3a7-4a3f0d6f0d3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.398745 Aug 30 04:29:02.729784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 202/406] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:02 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:03.738490 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:03.739078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:03.745876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.746365 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.746800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.747488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.747938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.748358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.749418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:03.750283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:03.758321 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.758809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.759305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.759927 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.760390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.760867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.952016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:03.955709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:03.960994 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-469bb5a6-6d8c-4dc7-9197-b27dd0dbeeb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.226946 Aug 30 04:29:03.961601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 205/407] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:03 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:03.963376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-67b7495f-70a6-4227-8b25-f6137b46422e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.217762 Aug 30 04:29:03.963948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 203/408] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:03 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:04.982364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:04.982987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:04.983498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:04.984138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:04.990010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.990492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.990926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:04.991038 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.991518 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.991628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.992218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:04.992337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.992733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:04.992903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.993395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.993817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.182387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:05.185272 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:05.190561 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-146b74d5-2bb4-4ab3-a96f-727c615dba13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.212039 Aug 30 04:29:05.191171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 206/409] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:04 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:05.192929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f06ad560-0ca8-4a64-b04e-7a73c3c06a9a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.213207 Aug 30 04:29:05.193584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 204/410] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:04 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:06.212278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.212895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:06.215225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.215225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:06.223221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.223388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.223494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.223602 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.223686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.223771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.223863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.223948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.224041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.224132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.224212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.224289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.421426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.429526 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.429871 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-04ae467b-9b1c-4d75-9207-cbec9e18fc2b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.220416 Aug 30 04:29:06.430447 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 205/411] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:06 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:06.434923 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.435663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:06.439326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-843c0704-3adb-4afd-8a85-ef38d265bc56 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.231213 Aug 30 04:29:06.440099 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 207/412] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:06 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:06.443358 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.443916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.444875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.445677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.446176 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.446595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.473784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:06.521565 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:06.553968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-34796435-2ec5-4ff6-8408-d7602c25ab2d tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 204 len: 0 microversion: 2.1 time: 0.122324 Aug 30 04:29:06.554576 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 206/413] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:06 2022] DELETE /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:06.562753 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.563373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:06.569385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.569871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.570308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.570994 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.571446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.571869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.703399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.712380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-50570005-acc5-45b5-ace1-729cf022401b tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.153450 Aug 30 04:29:06.712960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 208/414] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:06 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:07.454567 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:07.455266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:07.460028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:07.460651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:07.461721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.462204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.462639 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.463330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.464258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.464258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.467360 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.467850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.468290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.469028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.469510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.469937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.651609 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:07.658095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:07.659365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bb445c06-d6f1-4159-8332-cd5a45726fad tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.209573 Aug 30 04:29:07.659939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 207/415] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:07 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:07.665741 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5c2b1c8f-d234-4f22-8d20-11c6aa231ef6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.209517 Aug 30 04:29:07.666297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 209/416] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:07 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:07.733859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:07.734924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:07.740696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.741212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.741646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.742601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.743052 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.743470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.871339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:07.879843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f84a3fa7-1941-4706-9b09-2a17eac83fe9 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.149846 Aug 30 04:29:07.880399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 208/417] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:07 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:08.679708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:08.680355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:08.686485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:08.686937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.687092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:08.687361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.688474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.689205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.689664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.690089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.693972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.694454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.694888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.695570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.696017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.696436 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.704778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:08.883431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:08.887203 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:08.891738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f1ab892b-2f52-465e-b54e-dbae9cd205fa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.215832 Aug 30 04:29:08.892414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 210/418] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:08 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:08.895221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e5ba1fa2-fe44-452d-99dd-d4557a6e159e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.212517 Aug 30 04:29:08.895915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 209/419] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:08 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:08.904576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:08.905455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:08.912186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.912666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.913163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.913883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.914384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.914835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.041413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:09.049958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a4234227-4c38-4629-b1ca-215b7fcf7106 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.150910 Aug 30 04:29:09.050643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 211/420] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:08 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:09.912670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:09.913235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:09.915629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:09.916264 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:09.919721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.920205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.920630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.921340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.922326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.922694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.924324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.924815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.925391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.925977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.927706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.927706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:10.119938 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.123735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.130101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e6838df-e61c-493d-8466-6cca6cb5025a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.221470 Aug 30 04:29:10.132596 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cade1777-e7ea-45ce-a67b-9d51144354d2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.220855 Aug 30 04:29:10.141220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 212/421] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:09 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:10.141220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:10.141220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:10.141598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 210/422] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:09 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:10.144503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:10.144990 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:10.146001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:10.146559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:10.147007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:10.147426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:10.278876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.287128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e760186b-0a8d-4413-bcdb-07ff0cfeef62 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.152949 Aug 30 04:29:10.287696 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 213/423] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:10 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:11.151651 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:11.153064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:11.153594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:11.154407 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:11.159217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.159701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.160160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.160321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.160800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.161114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.161301 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.161574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.161939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.162044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.162379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.163046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.357359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:11.361784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:11.365966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d5317d97-d91e-421c-9c6d-6a4dc2bf58c7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.218626 Aug 30 04:29:11.366536 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 211/424] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:11 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:11.369916 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c9d387ea-30b4-4dbb-99ec-5a09f9f3e51d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.220478 Aug 30 04:29:11.370477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 214/425] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:11 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:11.372038 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:11.372652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:11.379196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.379676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.380107 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.380786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.381260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.381678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.510092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:11.518097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b0a6118e-61eb-4f43-8917-e89ec853a186 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.150303 Aug 30 04:29:11.518597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 212/426] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:11 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:12.387593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:12.388217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:12.392712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:12.393458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:12.395494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.396164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.396972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.397503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.397953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.398370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.401189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.401803 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.403929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.403929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.403929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.403929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.590420 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.594558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.598477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3ea984d0-466c-4b09-8405-19e1b3227424 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.211581 Aug 30 04:29:12.599174 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 213/427] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:12 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:12.602317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc046f88-556c-4aaa-b2fb-2e7132e41c57 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.218531 Aug 30 04:29:12.602880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 215/428] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:12 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:12.603784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:12.604383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:12.610305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.610884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.611424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.612202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.612713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.613227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.739289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.747085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cb275fc1-95ff-484a-998d-57b41140d5d7 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.146930 Aug 30 04:29:12.747637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 214/429] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:12 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:13.620694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:13.622034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:13.622929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:13.623740 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:13.628158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.628643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.629285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.629981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.630435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.630578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.630859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.630977 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.631326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.632014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.632474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.632892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.834522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:13.841373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:13.842802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ea735e6-a4cb-480b-9700-b095c288ba4e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.227277 Aug 30 04:29:13.850014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 216/430] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:13 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:13.850014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:13.850014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:13.854087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-38feab62-5ef2-4c71-9896-5334f2adfd3f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.235084 Aug 30 04:29:13.854976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.855870 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 215/431] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:13 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:13.856086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.856608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.857399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.857911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.858410 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.998688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:14.007003 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ebe29d57-2205-45d7-a3ab-d8cc8f4920bc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.162580 Aug 30 04:29:14.007564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 217/432] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:13 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:14.864326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:14.864880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:14.871555 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:14.872043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:14.872484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:14.873204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:14.873657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:14.874083 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:14.877612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:14.878225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:14.884527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:14.885007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:14.885475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:14.886166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:14.886617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:14.887036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.199276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:15.207349 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-45079657-922e-44eb-8bd7-b1f30c6239e3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.346937 Aug 30 04:29:15.207918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 216/433] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:14 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:15.212483 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.213310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:15.219613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.220107 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.220612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.221324 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.222116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.222708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.229265 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:15.237351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce12b3d4-db1d-444e-9e93-2aad95c9957f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.363477 Aug 30 04:29:15.238091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 218/434] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:14 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:15.326747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.327237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:15.333676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.334164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.334601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.335288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.335738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.336156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.427748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:15.439099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3bfc9c89-7efa-4f99-bcf3-3a4f8b39b042 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1504 microversion: 2.1 time: 0.229653 Aug 30 04:29:15.455692 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 217/435] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:15 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:15.486176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lazy-loading 'services' on Instance uuid 53019836-c870-4c39-b085-179b6fb4e517 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:15.549417 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5c6cac41-bb33-44c1-905c-58014ddcce66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:15.556433 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c6cac41-bb33-44c1-905c-58014ddcce66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.557196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c6cac41-bb33-44c1-905c-58014ddcce66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.557630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c6cac41-bb33-44c1-905c-58014ddcce66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.632430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5c6cac41-bb33-44c1-905c-58014ddcce66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Going to try to stop instance {{(pid=120715) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:29:15.647245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c23a52a-92f0-4b22-b136-8c4d8757a2ff tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517/os-volume_attachments/1ed578fb-1149-4c0e-b723-5ec900f254fd" status: 202 len: 0 microversion: 2.1 time: 0.324201 Aug 30 04:29:15.648496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 219/436] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:29:15 2022] DELETE /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517/os-volume_attachments/1ed578fb-1149-4c0e-b723-5ec900f254fd => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:29:15.715546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5c6cac41-bb33-44c1-905c-58014ddcce66 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action" status: 202 len: 0 microversion: 2.1 time: 0.169836 Aug 30 04:29:15.717249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 218/437] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:29:15 2022] POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:15.731789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-dbdcd6d3-f5ff-40e2-adf8-0898ebe69f14 req-75251b3a-0c37-4ec0-9ccf-ec7824be7381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5571ed9-9e05-4ace-8641-f598d247960a", "name": "network-vif-deleted", "tag": "9bb909ce-9d58-4d61-a46f-d9e132bf03a8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:15.734017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.734768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:15.741029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.741537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.742245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.742932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.743353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-dbdcd6d3-f5ff-40e2-adf8-0898ebe69f14 req-75251b3a-0c37-4ec0-9ccf-ec7824be7381 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.743485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.743771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.743867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-dbdcd6d3-f5ff-40e2-adf8-0898ebe69f14 req-75251b3a-0c37-4ec0-9ccf-ec7824be7381 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.744275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-dbdcd6d3-f5ff-40e2-adf8-0898ebe69f14 req-75251b3a-0c37-4ec0-9ccf-ec7824be7381 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.757889 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-dbdcd6d3-f5ff-40e2-adf8-0898ebe69f14 req-75251b3a-0c37-4ec0-9ccf-ec7824be7381 service nova] Creating event network-vif-deleted:9bb909ce-9d58-4d61-a46f-d9e132bf03a8 for instance a5571ed9-9e05-4ace-8641-f598d247960a on hv-cinder-85426 Aug 30 04:29:15.766252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-dbdcd6d3-f5ff-40e2-adf8-0898ebe69f14 req-75251b3a-0c37-4ec0-9ccf-ec7824be7381 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038205 Aug 30 04:29:15.767173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 220/438] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:15.876424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:15.884654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9e91517e-f3d1-43b6-bce9-2ca94b40aa82 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.154864 Aug 30 04:29:15.885237 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 219/439] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:15 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:16.229406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.230310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:16.237587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.238072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.238503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.239187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.239638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.240061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.258399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.259043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:16.264961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.265619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.266056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.266747 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.267262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.267707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.433378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.440928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5130e52c-1572-4c80-a1ed-fcb36fe7aa10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.216019 Aug 30 04:29:16.442530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 221/440] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:16.444009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.451679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-25935416-3b68-44ac-9aee-9b42e9bd6cd4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.197143 Aug 30 04:29:16.452227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 220/441] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:16.459739 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.460589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:16.466526 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.467014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.467454 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.468144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.469163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.469592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.500711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.501618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.501856 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.502091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:16.548551 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.557543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-98226541-3d57-4770-872a-bc1619acd0f6 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.101669 Aug 30 04:29:16.558322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 222/442] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:16.905520 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.906817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:16.913174 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.913652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.914082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.914759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.915201 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.915617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.042258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.050395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2bb68102-1657-4306-ab18-982006f48744 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.148723 Aug 30 04:29:17.050987 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 221/443] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:17.461659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.462263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.464656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=90 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:17.470130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.470620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.471049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.471735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.472067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.472169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.472583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.473101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.479482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.480671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.481215 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.482028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.482619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.483165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.488082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:17.663553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.671226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f62a3df2-2e69-4c50-a999-ea14aa3eeddc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1501 microversion: 2.1 time: 0.213480 Aug 30 04:29:17.678627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 223/444] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:17.678796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.678934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.678934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.683228 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-294ed99e-3c32-4c81-ab11-63438881cb32 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.215412 Aug 30 04:29:17.683916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 222/445] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:17.684065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.684544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.685127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.685840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.686299 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.686726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.695381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15280ab7-a043-455c-8810-9cf484c603f7"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:17.697923 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.703807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.704363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.704863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.705654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.706106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.706525 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.718789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.719423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.720210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.720329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:17.729431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] HTTP exception thrown: Cannot 'attach_volume' instance f359fb4c-9bdc-4898-81b0-26ea768f4444 while it is in vm_state rescued Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Request method failure captured: Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/os-volume_attachments HTTP/1.1 Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 74 Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFtkdK4PHrjmXsqakn6snyPe3OEZXbSJoaTrGZuOhInCE8AFbRFkPJrS-6B0yrHIS-v637tc77DslZ4uuDNpjfoxsqf8mGVQroVdXuSyfS4tuxgbq5tV3eNjAp1IwCezOre8Yvje9s0Amlk66K2u-OKwwRchElJ2-EyY91fV7UdQAM Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:29:17.731085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_edc09fe630034be4b292562e2de6e3f9"}]}] Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: cbf574ed57d446bc8fabe7813e64e92c Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {"volumeAttachment": {"volumeId": "15280ab7-a043-455c-8810-9cf484c603f7"}} Aug 30 04:29:17.732676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Cannot 'attach_volume' instance f359fb4c-9bdc-4898-81b0-26ea768f4444 while it is in vm_state rescued Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'server_id': 'f359fb4c-9bdc-4898-81b0-26ea768f4444', 'body': {'volumeAttachment': {'volumeId': '15280ab7-a043-455c-8810-9cf484c603f7'}}} Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:17.733658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f359fb4c-9bdc-4898-81b0-26ea768f4444 while it is in vm_state rescued Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:17.735484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f359fb4c-9bdc-4898-81b0-26ea768f4444 while it is in vm_state rescued Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Returning 409 to user: Cannot 'attach_volume' instance f359fb4c-9bdc-4898-81b0-26ea768f4444 while it is in vm_state rescued {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-33edb5e5-ab88-423e-a2c3-aae6f229e433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043085 Aug 30 04:29:17.736729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 223/446] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:29:17 2022] POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:29:17.741892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:17.742430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.748265 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.748748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.749213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.749902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.750347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.750762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.761665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.769383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-267bac02-c26a-479d-a923-979ec50175ca tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.095410 Aug 30 04:29:17.769956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 224/447] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:17.821310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5dff8701-1378-437d-95ff-d73b0943f1b7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/action" status: 202 len: 0 microversion: 2.1 time: 0.083004 Aug 30 04:29:17.824310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 224/448] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:29:17 2022] POST /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:17.830858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.831476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.837412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.837897 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.838336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.839027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.839480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.839906 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.969984 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.977662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c20bea9a-a8ba-472c-a6ab-9318945ecf85 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.151450 Aug 30 04:29:17.978732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 225/449] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:18.072920 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.073673 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:18.080612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.081079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.081522 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.082222 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.082671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.083092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.115404 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-8dfc6329-c187-423e-9222-96b8bb40c917 req-30fe6ecb-aeb9-4c86-90e2-448cc9522abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "name": "network-vif-plugged", "status": "completed", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:18.127898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8dfc6329-c187-423e-9222-96b8bb40c917 req-30fe6ecb-aeb9-4c86-90e2-448cc9522abc service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.128609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8dfc6329-c187-423e-9222-96b8bb40c917 req-30fe6ecb-aeb9-4c86-90e2-448cc9522abc service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.129243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8dfc6329-c187-423e-9222-96b8bb40c917 req-30fe6ecb-aeb9-4c86-90e2-448cc9522abc service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.143187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-8dfc6329-c187-423e-9222-96b8bb40c917 req-30fe6ecb-aeb9-4c86-90e2-448cc9522abc service nova] Creating event network-vif-plugged:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:29:18.148405 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-8dfc6329-c187-423e-9222-96b8bb40c917 req-30fe6ecb-aeb9-4c86-90e2-448cc9522abc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037818 Aug 30 04:29:18.148994 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 226/450] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:18.222767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:18.230999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0c736bef-fd75-46f8-9bed-a7f15041c0a9 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.162849 Aug 30 04:29:18.231550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 225/451] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:18 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:18.706283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.707139 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:18.714421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.715103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.715669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.716479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.717070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.717703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.722910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:18.791505 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.792120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:18.799142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.799627 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.800180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.800902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.801585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.802156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.835852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.836719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.837338 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.837776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:18.950896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:18.959701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-64deb3a3-170b-40d3-b2bf-78dc2fda913e tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.172979 Aug 30 04:29:18.960857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 226/452] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:18 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:19.002046 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.002397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:19.005608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:19.009172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.010013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.010440 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.011127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.011567 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.012156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.013949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e1482ccd-0d6c-45f0-bf22-8d79cc92a85a tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.313904 Aug 30 04:29:19.014516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 227/453] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:18 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:19.252327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.252861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:19.259864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.260358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.260821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.261554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.262191 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.262641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.349450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:19.357116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3aa312e8-4b80-469e-8497-c7ece123ca97 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.361103 Aug 30 04:29:19.357682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 227/454] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:18 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:19.429765 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:19.437938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-186700e1-f661-458d-829d-a78ccf1f7514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.189806 Aug 30 04:29:19.438498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 228/455] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:19 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:19.977047 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.977561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:19.984168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.984642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.984814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.984912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:19.985244 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.985983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.986441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.986864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.991160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.991900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.992332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.993020 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.993487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.993936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.012304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:20.025003 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.025510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.025946 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.026384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:20.071953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.080181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1e1c3bcf-8b4e-4677-bcc8-06bb10929a81 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.099763 Aug 30 04:29:20.080749 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 229/456] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:19 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:20.085369 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:20.085972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:20.091678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.092170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.092608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.093353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.093862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.094698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.098288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7331ca4f-9dd4-4d58-941a-77d6c6cb0748 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 204 len: 0 microversion: 2.1 time: 0.124761 Aug 30 04:29:20.098873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 228/457] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:19 2022] DELETE /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:20.107563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:20.108355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:20.114608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.115095 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.115531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.116232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.116980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.117400 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.332207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.341060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-520fb16e-430f-4164-8da4-2a251e0b5dfa tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.258454 Aug 30 04:29:20.341181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 230/458] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:20 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:20.343648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.351862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-629e51af-1156-4565-901e-945d86eb25f8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1513 microversion: 2.1 time: 0.248515 Aug 30 04:29:20.354183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 229/459] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:20 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:20.379904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:20.380517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:20.386366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.386847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.387285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.387971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.388423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.388850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.459379 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:20.460267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:20.466438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.466921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.467352 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.468162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:20.469134 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:20.469558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.527671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.536135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6dcb2fe0-e353-4fd7-99cb-5ea140cea56e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.159954 Aug 30 04:29:20.536704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 231/460] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:20 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:20.614850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.623283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cbc0f3cf-da94-44f9-a046-b757f56ec7ac tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.167651 Aug 30 04:29:20.623837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 230/461] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:20 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:21.100259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.101421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.114755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.115251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.115863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.116828 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.117324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.117746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.152137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.152771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.153294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.153797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:21.195840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:21.204797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ad71354e-7bf2-47c1-9e8f-44da1978befe tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.108263 Aug 30 04:29:21.206398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 232/462] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:21.362388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.362931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.369992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.370487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.370900 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.371585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.372032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.372449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.373057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.373785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.380344 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.380909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.381447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.382231 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.382758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.383258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.567190 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:21.571286 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:21.574983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f373da21-964b-41e1-8904-ea68a3a4bdfc tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.217003 Aug 30 04:29:21.575650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 231/463] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:21.578927 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f2522f79-b86a-4c58-a329-ce64707b272f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1513 microversion: 2.1 time: 0.210037 Aug 30 04:29:21.579662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 233/464] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:21.580100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.580708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.586491 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.586974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.587404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.588084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.588532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.588946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.644384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.644921 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.651262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.651787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.652354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.653068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.653553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.653974 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.755220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:21.764098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-12a8dd43-f0db-4472-b9be-5efba0ff0d7a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.187458 Aug 30 04:29:21.764750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 232/465] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:21.810233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:21.818523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-90e11bfa-5139-4022-8170-7e232bcf7371 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.178094 Aug 30 04:29:21.819094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 234/466] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:22.225017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:22.225651 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:22.231627 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.232110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.232544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.233271 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.233725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.234149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.264102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.264573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.265677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.266110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:22.305907 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.314101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-107c7991-2b77-4caa-bbfe-1ca35794a7dc tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.093001 Aug 30 04:29:22.314660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 233/467] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:22 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:22.595587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:22.596304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:22.599594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:22.600214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:22.603108 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.603597 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.604033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.604730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.605214 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.605638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.606073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.606556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.606989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.607673 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.608125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.608545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.796823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.800310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.805406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-edd592d0-12d7-4f10-9292-f9cd58873b77 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1358 microversion: 2.1 time: 0.213573 Aug 30 04:29:22.806064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 235/468] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:22 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:22.808517 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a2ffe3f0-a37b-46dc-8e2f-92a72bb36bf0 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1513 microversion: 2.1 time: 0.212849 Aug 30 04:29:22.809517 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 234/469] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:22 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:22.810955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:22.811573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:22.818006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.818623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.819177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.819870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.820331 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.820756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.839564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:22.840353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:22.846620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.847120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.847625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.848405 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.848926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.849446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.005092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:23.013015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c95724a4-0b32-4864-96cd-6a89a7e42439 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.205962 Aug 30 04:29:23.013728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 236/470] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:22 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:23.030830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:23.034753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:23.040751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6a00cec3-8919-4793-a3b1-740a4dade6e5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.204952 Aug 30 04:29:23.041752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 235/471] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:22 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:23.334073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:23.334680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:23.340575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.341065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.341500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.342172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.342615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.343183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.372948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.373388 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.373813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.374242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:23.414810 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:23.422923 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c4da3dcf-b1b0-487f-925e-568294451fec tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.092621 Aug 30 04:29:23.423490 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 237/472] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:23 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:23.830060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:23.830719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:23.831089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:23.831213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:23.833022 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:23.837219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.837691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.838124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.838897 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.839009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.839352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.839487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.839770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.839919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.840604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.841062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.841493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.037949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.041497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.046153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-142c2d57-008d-4faf-a268-f311ea40cca3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1548 microversion: 2.1 time: 0.220474 Aug 30 04:29:24.047452 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 236/473] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:23 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1548 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:24.052391 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:24.053460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:24.058105 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e78a4fc3-c685-406d-9e8a-31a425d924b4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1513 microversion: 2.1 time: 0.231752 Aug 30 04:29:24.069842 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 238/474] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:23 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:24.071671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.072168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.072597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.073531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.073986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.074404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.075157 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:24.075777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:24.086323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.086820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.087256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.087957 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.088416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.088838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.270002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.273725 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.277981 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9d26f516-e966-4f3b-9f90-0a26a3f48a4a tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.229403 Aug 30 04:29:24.278551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 237/475] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:24 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:24.282008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b8c24342-19bd-428d-aa88-3ebec0213932 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.210648 Aug 30 04:29:24.282723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 239/476] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:24 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:24.283429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:24.284030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:24.289758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.290235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.290664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.291447 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.292031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.292410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.422951 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.430704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4d7caf0f-2365-44bd-a7d0-1237037223cd tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1548 microversion: 2.1 time: 0.151216 Aug 30 04:29:24.431253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 238/477] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:24 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:24.444275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:24.444892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:24.450641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:24.450849 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.451394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.451837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.452617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.453176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.453639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.455566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.456334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Searching by: {'deleted': False, 'project_id': '3a706ffd11144f46ba54becd86464f02'} {{(pid=120715) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:29:24.462831 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.463305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.463730 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.464443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.464887 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.465326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.486211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.486698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.487132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.487576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lazy-loading 'fault' on Instance uuid a5571ed9-9e05-4ace-8641-f598d247960a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:24.529889 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148a7e11786a4a54909c4a0679407b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf61cc87384ade8eb07b032bb6292b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.538470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-80d51302-de26-473c-8e49-2f397a1e0f79 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 200 len: 1304 microversion: 2.1 time: 0.098070 Aug 30 04:29:24.539298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 240/478] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:24 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:24.556957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.multi_cell_list [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120715) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:29:24.649166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e3718e84-7d62-4c26-a067-0ed42754e309 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202114 Aug 30 04:29:24.649746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 239/479] 10.222.0.85 () {58 vars in 1125 bytes} [Tue Aug 30 04:29:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:24.661305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:24.661915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:24.667742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.668213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.668640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.669344 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:24.669793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:24.670209 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.872404 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.880562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3faec26e-a933-46b5-9d1e-d26f631ea212 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1548 microversion: 2.1 time: 0.222893 Aug 30 04:29:24.881492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 241/480] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:24 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:25.088701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:25.089593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:25.105287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.105795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.106238 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.106944 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.107385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.107805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.265888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:25.275404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9466ef6e-f530-4e75-9dfc-16a9444ee049 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1513 microversion: 2.1 time: 0.191551 Aug 30 04:29:25.290044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 240/481] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:25 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:25.301287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:25.302119 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:25.305768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:25.307641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:25.308483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.308971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.309585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.310602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.311195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.311796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.315351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.315472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.315965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.316712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.317472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.317919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.330623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:25.518844 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:25.522060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:25.526664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-83a7d920-24fd-468f-ac2c-6cb39b70d1f1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.231738 Aug 30 04:29:25.527237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 242/482] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:25 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:25.530406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2f04277c-2d71-4f9d-a37a-6dedf38433f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.230604 Aug 30 04:29:25.531569 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 241/483] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:25 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:25.532108 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-58c4bf0e-299f-40a1-9fa9-6cafb3db9b7f req-f0fb0c9f-23a3-4aa4-86c7-d4ebeea84bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53019836-c870-4c39-b085-179b6fb4e517", "name": "network-vif-deleted", "tag": "0fcce26e-b672-4e4b-aea3-9d7cd3bc24ba"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:25.541359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-58c4bf0e-299f-40a1-9fa9-6cafb3db9b7f req-f0fb0c9f-23a3-4aa4-86c7-d4ebeea84bc2 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.541836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-58c4bf0e-299f-40a1-9fa9-6cafb3db9b7f req-f0fb0c9f-23a3-4aa4-86c7-d4ebeea84bc2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.542262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-58c4bf0e-299f-40a1-9fa9-6cafb3db9b7f req-f0fb0c9f-23a3-4aa4-86c7-d4ebeea84bc2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.554040 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-58c4bf0e-299f-40a1-9fa9-6cafb3db9b7f req-f0fb0c9f-23a3-4aa4-86c7-d4ebeea84bc2 service nova] Creating event network-vif-deleted:0fcce26e-b672-4e4b-aea3-9d7cd3bc24ba for instance 53019836-c870-4c39-b085-179b6fb4e517 on hv-cinder-85426 Aug 30 04:29:25.559082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-58c4bf0e-299f-40a1-9fa9-6cafb3db9b7f req-f0fb0c9f-23a3-4aa4-86c7-d4ebeea84bc2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Aug 30 04:29:25.559659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 243/484] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:25.560139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:25.560765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] [instance: a5571ed9-9e05-4ace-8641-f598d247960a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:25.567013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.567494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.567929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.568669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.569302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.569731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.585980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] HTTP exception thrown: Instance a5571ed9-9e05-4ace-8641-f598d247960a could not be found. Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Request method failure captured: Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a HTTP/1.1 Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZG1MlHjcljoE7tamAEfvvvxfe8KwEJiP5pYEJBubH_HL_bIvX1Jyw8verBn6fLwamMhbMN3H17wU4AblsjSFYLzEzHfEEZUrjskn0VoO9FP_K0Ska3jxiUVV-eCPzGPgA8xLPoKyglEieWFXhxtkJ4DR8MKl6wS6-uotp_9kxFIzQE Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: bdbf61cc87384ade8eb07b032bb6292b Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesActionsTest-967137002 Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:29:25.587571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdbf61cc87384ade8eb07b032bb6292b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdbf61cc87384ade8eb07b032bb6292b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdbf61cc87384ade8eb07b032bb6292b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdbf61cc87384ade8eb07b032bb6292b"}]}] Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesActionsTest-967137002 Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: bdbf61cc87384ade8eb07b032bb6292b Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesActionsTest-967137002 Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesActionsTest-967137002-project Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 148a7e11786a4a54909c4a0679407b80 Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesActionsTest-967137002-project Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance a5571ed9-9e05-4ace-8641-f598d247960a could not be found. Aug 30 04:29:25.589031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'a5571ed9-9e05-4ace-8641-f598d247960a'} Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5571ed9-9e05-4ace-8641-f598d247960a could not be found. Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:25.589912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5571ed9-9e05-4ace-8641-f598d247960a could not be found. Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5571ed9-9e05-4ace-8641-f598d247960a could not be found. Aug 30 04:29:25.591277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:29:25.592492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] Returning 404 to user: Instance a5571ed9-9e05-4ace-8641-f598d247960a could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:25.592492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d6846305-1a5e-457b-9931-e30d67fb78b3 tempest-VolumesActionsTest-967137002 tempest-VolumesActionsTest-967137002-project] 10.222.0.85 "GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a" status: 404 len: 111 microversion: 2.1 time: 0.033208 Aug 30 04:29:25.592492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 242/485] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:25 2022] GET /compute/v2.1/servers/a5571ed9-9e05-4ace-8641-f598d247960a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:29:26.308105 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:26.308801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:26.320143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.320684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.321155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.321858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.322313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.322735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.388517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.396314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dd039135-51f4-49f4-b553-85db0b320427 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1471 microversion: 2.1 time: 0.093625 Aug 30 04:29:26.396897 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 244/486] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:26 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:26.473614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ed2af32-e5b5-473e-90ed-2d0dd261b23d"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:26.476086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:26.482628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.483120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.484087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.484810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.485332 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.485789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.548993 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:26.549629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:26.555590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.556078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.556510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.557269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.557724 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.558143 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.688908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.696440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77c883cc-cb46-49c8-889d-d86f53b63cfd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.152024 Aug 30 04:29:26.697001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 245/487] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:26 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:26.704375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:26.704375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:26.707483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.708092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.708566 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.709294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.709749 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.710172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.836356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.845092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0ee127c2-cc42-4fbe-b770-c6d6eaebe203 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.147125 Aug 30 04:29:26.845665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 246/488] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:26 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:27.416939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.417534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.423938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.424424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.424860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.425590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.426044 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.426470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.487642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.495661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-67c7c5a1-0422-4d39-a2f8-ea1bc25bdef7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1471 microversion: 2.1 time: 0.082587 Aug 30 04:29:27.496224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 247/489] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:27.717541 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.718181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.724281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.724796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.725282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.725977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.726432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.726891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.856251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.864719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b3108d76-d382-4002-aa83-51bde72db548 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.151014 Aug 30 04:29:27.865327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 248/490] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:27.869934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.870570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.876685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.877199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.877642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.878342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.878779 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.879203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.005888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:28.014024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5c827de8-e047-44c7-bffd-28abe4868608 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.147766 Aug 30 04:29:28.014585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 249/491] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:28.517555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:28.518170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:28.524499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.524967 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.525434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.526123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.526581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.527003 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.587095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:28.594686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-81d0199f-29da-42e2-a5f7-0afcdac3b5c6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1471 microversion: 2.1 time: 0.081618 Aug 30 04:29:28.595259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 250/492] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:28 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1471 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:28.886908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:28.887527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:28.893480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.893964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.894397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.895085 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.895541 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.895964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.022614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.030203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3d7b06b7-b715-4804-a1bd-9504db4e1e13 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.147140 Aug 30 04:29:29.030768 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 251/493] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:28 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:29.035655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:29.036257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:29.041877 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.042366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.042804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.043490 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.043953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.044369 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.169775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.178677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ae2e2db4-9040-47bd-af90-b8136f474bbd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.146462 Aug 30 04:29:29.179303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 252/494] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:29 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:29.615878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:29.616741 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:29.623120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.623595 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.624020 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.624695 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.625770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.626187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.687084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.694569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fea7d1bc-0432-44f2-b398-15e84dd516e5 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1471 microversion: 2.1 time: 0.082507 Aug 30 04:29:29.695126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 253/495] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:29 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:30.051248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:30.051866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.057781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.058261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.058700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.059381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.059833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.060252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.190277 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.197936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-50d855ac-74c6-4722-8783-8f1a7b3f745b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.150507 Aug 30 04:29:30.198499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 254/496] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:30 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:30.202812 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:30.203914 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.209538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.210061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.210499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.211216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.211716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.212178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.336902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.345583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d6457bbc-51a5-46b9-8367-d79344d7e867 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.146153 Aug 30 04:29:30.346148 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 255/497] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:30 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:30.715396 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:30.716008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.722330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.722804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.723229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.723910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.724350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.724762 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.788533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.796274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d5811c47-2f49-4e79-b349-1cc4ef2c1c80 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1471 microversion: 2.1 time: 0.084671 Aug 30 04:29:30.797372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 256/498] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:30 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:31.218173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:31.219422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:31.225414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.225890 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.226320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.226995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.227440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.227855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.351672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:31.359327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-764eb943-e78b-452a-b7a9-a887d638cce8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1509 microversion: 2.1 time: 0.145005 Aug 30 04:29:31.360827 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 257/499] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:31 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:31.366339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:31.367283 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:31.372910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.373423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.373853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.374532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.374983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.375402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.504583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:31.520224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3981dc8b-a5ac-46fc-bc31-5ff66d233832 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.157041 Aug 30 04:29:31.521315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 258/500] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:31 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:31.820594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:31.821554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:31.828330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.829384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.830096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.830983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.831632 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.832128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.864715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.865239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.865665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.866103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lazy-loading 'fault' on Instance uuid 53019836-c870-4c39-b085-179b6fb4e517 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:31.869154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:31.922865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:31.931635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-167d8821-62e6-44bf-89c8-f95a5c6abe79 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1309 microversion: 2.1 time: 0.115545 Aug 30 04:29:31.932577 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 259/501] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:31 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:31.956150 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-00ecbbf4-6d79-4dcd-8c46-733ea3d8016f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.486464 Aug 30 04:29:31.956904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 243/502] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:29:26 2022] POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments => generated 194 bytes in 5488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:32.380508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:32.381258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:32.387497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.388058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.388560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.389413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.389737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.390158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.528805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.542142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:32.542844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:32.547348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4de9cd1e-be37-4cc9-b4be-8fda22d9caeb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1515 microversion: 2.1 time: 0.170612 Aug 30 04:29:32.548109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 260/503] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:32 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:32.551408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.551900 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.552334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.553155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.553613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.554038 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.742044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.759566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68413b1b-5cda-4996-9659-0cb756578e81 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.220893 Aug 30 04:29:32.770491 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 244/504] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:32 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:32.954327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:32.954946 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:32.980040 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.004068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.008095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.011791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.013470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.014164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.066563 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.067349 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.068009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.068855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lazy-loading 'fault' on Instance uuid 53019836-c870-4c39-b085-179b6fb4e517 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:33.178581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:33.190094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5edf14c5-bae5-4f64-b950-79854cd82d06 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1309 microversion: 2.1 time: 0.239787 Aug 30 04:29:33.204019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 261/505] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:32 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:33.782386 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.782986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:33.789531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.790013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.790441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.791121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.791569 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.791985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.123241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-69076629-5c0f-47d2-a2fc-d4efe41778f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'create', calling method: .version_select at 0x7fcda81194c0>, body: {"keypair": {"name": "tempest-keypair-671196160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvAkLrYORVzMK1TaChDfklbIiMMmwdvcRhbkQEDvRl8lQc5MFddKpUCdCq9EWYoZKm2igDOoNnw36ASyVSjBb44oak8DS2S2DukC0AewBp43CeQ8CiZ28Q+hz1QLxWSCg=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:34.146751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-69076629-5c0f-47d2-a2fc-d4efe41778f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for project edc09fe630034be4b292562e2de6e3f9. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:34.152869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-69076629-5c0f-47d2-a2fc-d4efe41778f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for user cbf574ed57d446bc8fabe7813e64e92c and project edc09fe630034be4b292562e2de6e3f9. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:34.168070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:34.177785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.185868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-69076629-5c0f-47d2-a2fc-d4efe41778f4 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066825 Aug 30 04:29:34.186407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c3050811-372a-4f8a-b88f-439284a42daa tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.407893 Aug 30 04:29:34.187347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 262/506] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:29:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:34.197086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 245/507] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:34.213338 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:34.214053 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:34.224681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.225583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.226273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.227021 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.227527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.227957 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.271821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.272385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.272906 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.273447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lazy-loading 'fault' on Instance uuid 53019836-c870-4c39-b085-179b6fb4e517 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:29:34.327006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.335733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-acf39500-e56b-433b-bc3f-34f9f0fa0142 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 200 len: 1309 microversion: 2.1 time: 0.126358 Aug 30 04:29:34.336491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 263/508] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:34 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:35.221551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.223371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.242604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:35.246250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.247631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.248451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.250391 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.251518 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.252567 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.358838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.360716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 53019836-c870-4c39-b085-179b6fb4e517] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.367677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.368457 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.369135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.370066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.370618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.371122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.386163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] HTTP exception thrown: Instance 53019836-c870-4c39-b085-179b6fb4e517 could not be found. Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Request method failure captured: Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 HTTP/1.1 Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZGlN85o103sdJFthfSABaJO4xmGsoHiF7tiGzz-4hFXG82i1z9PsMM_BQ3rDijTNfQ3UgWaKwugIPeLXTVsmyC5aZs511liV3u4fJ8TzW-MS3MoK2iYOut5pzF3nWG0DrkAATXvdnuZHu2b1A6hwplDwWrnC-6L_6oyozO3uJiWCFM Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 2d8842fc1da94bf681eeb42464032b8a Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1380366567 Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:29:35.388174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2d8842fc1da94bf681eeb42464032b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2d8842fc1da94bf681eeb42464032b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2d8842fc1da94bf681eeb42464032b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2d8842fc1da94bf681eeb42464032b8a"}]}] Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotTestJSON-1380366567 Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 2d8842fc1da94bf681eeb42464032b8a Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1380366567 Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotTestJSON-1380366567-project Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 3a25d172babb4cd698fac79d7412d25b Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotTestJSON-1380366567-project Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 53019836-c870-4c39-b085-179b6fb4e517 could not be found. Aug 30 04:29:35.389601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '53019836-c870-4c39-b085-179b6fb4e517'} Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53019836-c870-4c39-b085-179b6fb4e517 could not be found. Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:35.390357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53019836-c870-4c39-b085-179b6fb4e517 could not be found. Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53019836-c870-4c39-b085-179b6fb4e517 could not be found. Aug 30 04:29:35.391588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:29:35.392659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Returning 404 to user: Instance 53019836-c870-4c39-b085-179b6fb4e517 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:35.392659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-41285d34-f7a9-481d-88c8-9244deddb69f tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517" status: 404 len: 111 microversion: 2.1 time: 0.035234 Aug 30 04:29:35.394348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 264/509] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/53019836-c870-4c39-b085-179b6fb4e517 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:35.582492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:35.592356 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f7a164ee-12c7-4738-84e8-5de5fda0b1e8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.377215 Aug 30 04:29:35.593636 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 246/510] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:36.004654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1491780839", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "661607d2-cb41-40c5-ac13-3334a7f66c5e"}], "security_groups": [{"name": "tempest-securitygroup--1716965877"}], "key_name": "tempest-keypair-671196160", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:36.114416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] validate_networks() for [('661607d2-cb41-40c5-ac13-3334a7f66c5e', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:36.531236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:36.531934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:36.532112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:36.532748 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:36.533449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:36.544217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.548039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.548694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.549510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.550084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.550748 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.573557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for project edc09fe630034be4b292562e2de6e3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:36.589233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Getting quotas for user cbf574ed57d446bc8fabe7813e64e92c and project edc09fe630034be4b292562e2de6e3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:36.601941 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:36.608683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:36.623124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.624545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.632697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.633375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.634056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.635019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.635723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.636366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.693514 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3b419bc4-ecf3-4615-afa7-1ff51759012e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.693475 Aug 30 04:29:36.704414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 265/511] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:36.721113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d407e791-5ba0-40f8-af79-9aae29848508 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.721113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d407e791-5ba0-40f8-af79-9aae29848508 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.845410 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d407e791-5ba0-40f8-af79-9aae29848508 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.857601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d407e791-5ba0-40f8-af79-9aae29848508 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1245 microversion: 2.1 time: 0.151903 Aug 30 04:29:36.872084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 266/512] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:36.938303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.950232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b865ce16-02f1-4ef3-a51f-85b26196221c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.331074 Aug 30 04:29:36.965634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 247/513] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:37.878543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:37.879178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:37.885760 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.886244 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.886673 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.887360 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.887809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.888226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.948031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.956054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5b17af92-2aa7-43c0-add5-40ae51da8f31 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1249 microversion: 2.1 time: 0.081355 Aug 30 04:29:37.956615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 267/514] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:37 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:37.975234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:37.975789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:37.982209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.982698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.983132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.983820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.984275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.984695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.114274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.123596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3ad66a69-fb9a-409d-b8ab-682b4c1136eb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.152155 Aug 30 04:29:38.124224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 248/515] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:37 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:38.976232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:38.976850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:38.983350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.983837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.984268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.984956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.985434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.985858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.045426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:39.053510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-25b50186-22ea-4935-a7a4-698af03eef83 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1249 microversion: 2.1 time: 0.081158 Aug 30 04:29:39.054075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 268/516] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:39.144930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:39.145571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:39.151928 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.152401 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.152829 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.153535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.153983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.154399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.281363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:39.289442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cc4d1eb4-9789-462c-ab1c-e1576cf746ff tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.148666 Aug 30 04:29:39.290002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 249/517] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:39 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.074378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:40.075090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:40.082314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.082864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.083531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.084293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.084944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.085529 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.154126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.162757 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8f1249a9-2904-446a-a418-3273b43534fb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1297 microversion: 2.1 time: 0.092213 Aug 30 04:29:40.163599 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 269/518] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.310630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:40.311152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:40.318216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.318704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.319139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.319826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.320291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.320726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.459505 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.469740 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-23ea63d0-b0b1-4264-8eab-8b0667bb3d57 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.163136 Aug 30 04:29:40.470306 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 250/519] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:41.187805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.188406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:41.195659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.196368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.196839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.197560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.198018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.198443 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.261838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:41.269975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aa93fc8b-5c5c-40bb-8fa4-d56a3a80c392 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1315 microversion: 2.1 time: 0.086512 Aug 30 04:29:41.270543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 270/520] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:41 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1315 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:41.490733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.491862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:41.498776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.499403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.499842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.501067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.501524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.502008 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.525739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:41.654792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:41.663339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-16f11a4e-ef63-47fa-b470-f0d8358886bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1722 microversion: 2.1 time: 0.176708 Aug 30 04:29:41.664236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 251/521] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:41 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:42.292242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.293188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:42.309790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.310620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.311226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.311981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.312979 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.313443 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.434542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.442861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6b4e603d-af10-44da-8fa4-945352d4af26 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1303 microversion: 2.1 time: 0.154680 Aug 30 04:29:42.443863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 271/522] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:42.684520 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.685958 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:42.694694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.695634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.696302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.697261 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.697925 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.698561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.886712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.903429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac930d4d-7769-4e26-9451-be9292a83d43 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1699 microversion: 2.1 time: 0.216774 Aug 30 04:29:42.904403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 252/523] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1699 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:42.926947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9c789a8e-1140-402e-9bd6-0faf34256d2d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:42.934338 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c789a8e-1140-402e-9bd6-0faf34256d2d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.935188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c789a8e-1140-402e-9bd6-0faf34256d2d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.935840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c789a8e-1140-402e-9bd6-0faf34256d2d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.016832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9c789a8e-1140-402e-9bd6-0faf34256d2d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Going to try to start instance {{(pid=120716) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:29:43.067160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9c789a8e-1140-402e-9bd6-0faf34256d2d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action" status: 202 len: 0 microversion: 2.1 time: 0.144880 Aug 30 04:29:43.068083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 272/524] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:29:42 2022] POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:43.076055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:43.076785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:43.083914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.084754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.085435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.086378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.086918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.087424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.307693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.328697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fd9c966d-8aac-4966-a317-18d330bf78b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1708 microversion: 2.1 time: 0.255955 Aug 30 04:29:43.329343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 253/525] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:43 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1708 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:43.475984 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:43.481309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:43.500207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.500763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.501243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.501955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.502412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.502841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.663989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.673120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a3946ca3-3548-4830-8134-05044bd999dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.211754 Aug 30 04:29:43.688876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 273/526] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:43 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:44.351122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.353079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.356852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:29:44.357610 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Tue Aug 30 04:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 (ip 10.222.0.85) !!! Aug 30 04:29:44.379168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.379823 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.380333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.381190 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.381871 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.382625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.556220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.567879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cb524865-d388-4508-85e8-b91a6082e106 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1708 microversion: 2.1 time: 0.221592 Aug 30 04:29:44.568748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 254/527] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:44 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1708 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:44.695695 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.697031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.704185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.704670 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.705138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.706025 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.706474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.706900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.848783 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.857323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3a77f604-060a-425d-b8d1-d2da00ece973 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.165405 Aug 30 04:29:44.858125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 274/528] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:44 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:45.595684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.596571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.603603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.604087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.604513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.605272 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.605945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.606459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.754708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:45.763625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-97f56ad2-4f29-486b-b47d-430ed2a5a32c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1708 microversion: 2.1 time: 0.174949 Aug 30 04:29:45.773664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 255/529] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1708 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:45.878583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.879347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.885937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.886619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.887277 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.887981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.888429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.889174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.037255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.046480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-48d6f528-eab8-40a1-9651-22f9e7e3f40d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.171641 Aug 30 04:29:46.047060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 275/530] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:46.786615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:46.787330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:46.802952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.803532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.807843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.808798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.819162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.819830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.081499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:47.083270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:47.087788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:47.089372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=12 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:47.096208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.099665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.100655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.101826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.102898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.106621 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.191918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.205413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-46d20134-0298-4fc1-8b3e-6c7f932c5873 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1708 microversion: 2.1 time: 0.422830 Aug 30 04:29:47.221477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 256/531] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:46 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1708 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:47.354677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-eff712cc-ef74-4063-affd-33f99da1b8d5 req-fb208971-67fa-4ca1-b100-9c4f6c24f0ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1ca12d-df37-4d58-b819-0e4c7df8fc9b", "tag": "d21ea63a-d1d4-48e3-8e7e-276477e7b961"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:47.397061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-eff712cc-ef74-4063-affd-33f99da1b8d5 req-fb208971-67fa-4ca1-b100-9c4f6c24f0ed service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.399528 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-eff712cc-ef74-4063-affd-33f99da1b8d5 req-fb208971-67fa-4ca1-b100-9c4f6c24f0ed service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.400474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-eff712cc-ef74-4063-affd-33f99da1b8d5 req-fb208971-67fa-4ca1-b100-9c4f6c24f0ed service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.413820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-eff712cc-ef74-4063-affd-33f99da1b8d5 req-fb208971-67fa-4ca1-b100-9c4f6c24f0ed service nova] Creating event network-changed:d21ea63a-d1d4-48e3-8e7e-276477e7b961 for instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b on hv-cinder-85426 Aug 30 04:29:47.416949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.419330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-eff712cc-ef74-4063-affd-33f99da1b8d5 req-fb208971-67fa-4ca1-b100-9c4f6c24f0ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068523 Aug 30 04:29:47.420234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 257/532] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:47.428025 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:47.428708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0056b1b6-670f-46cf-84a8-76d358875a10 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.352604 Aug 30 04:29:47.429365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:47.443025 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 276/533] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:47 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:47.451420 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.451919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.452348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.453064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.453516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.453931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.775511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1203236347", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "networks": [{"uuid": "bc930985-4717-47a0-be1a-d96b32a3da9c"}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:47.855170 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.864418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-57db6b3b-c90c-4ca4-9b04-912728062a6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1594 microversion: 2.1 time: 0.442765 Aug 30 04:29:47.864992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 258/534] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:47 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1594 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:47.867685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] validate_networks() for [('bc930985-4717-47a0-be1a-d96b32a3da9c', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:48.227327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.228026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.239507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.240277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.241662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.242555 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.243169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.243750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.313185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:48.313846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:48.314333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:48.314793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:48.315171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:48.331602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.332085 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.332510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.333262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.341788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.342424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.384434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Getting quotas for project 2d8842fc1da94bf681eeb42464032b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:48.394937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Getting quotas for user 3a25d172babb4cd698fac79d7412d25b and project 2d8842fc1da94bf681eeb42464032b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:48.426912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:48.431506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.432162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:48.440786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7ac4db67-d677-485a-95f5-abd656882c05 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1708 microversion: 2.1 time: 0.217472 Aug 30 04:29:48.459945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 259/535] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1708 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:48.470136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.475098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.482298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.483118 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.483878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.485441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.486121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.486779 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.505486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-45f569bf-ffe9-43d1-8edf-7d1960fa901c tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733743 Aug 30 04:29:48.506529 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 277/536] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:48.525947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9a9f5b48-ce05-4a4d-9ff3-a84d2f033dd4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.527292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a9f5b48-ce05-4a4d-9ff3-a84d2f033dd4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.710150 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a9f5b48-ce05-4a4d-9ff3-a84d2f033dd4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.722980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9a9f5b48-ce05-4a4d-9ff3-a84d2f033dd4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1219 microversion: 2.1 time: 0.209556 Aug 30 04:29:48.724124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 278/537] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:48.773804 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.792394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07cde192-3952-4d5c-8b50-99a1df7adac9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.330318 Aug 30 04:29:48.794157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 260/538] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:49.469132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:49.470932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:49.480190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.480986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.481752 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.482683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.483998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.484650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.507907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:49.747183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:49.748639 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:49.756153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.756876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.757564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.758489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.759130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.759928 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.864688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:49.879754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e54fd8fe-f5e6-4734-91f6-6863db9d5061 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1223 microversion: 2.1 time: 0.136803 Aug 30 04:29:49.880333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 261/539] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:49 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:49.884988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:49.887251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:49.898568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.902428 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.903104 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.904007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.904646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.905265 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.944066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:49.956296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7d824407-4298-4a86-b7ee-becb269e42d0 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1708 microversion: 2.1 time: 0.493092 Aug 30 04:29:49.956894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 279/540] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:49 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1708 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:50.059862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.068908 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e618741-ed06-47ff-8d15-80f4b1020289 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.187351 Aug 30 04:29:50.069660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 262/541] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:49 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:50.306087 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-c63a1579-1303-48d9-a227-7a8d95cdd44f req-863df21b-92ef-42ba-80b3-26389a59dcbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:50.322651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c63a1579-1303-48d9-a227-7a8d95cdd44f req-863df21b-92ef-42ba-80b3-26389a59dcbf service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.327052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c63a1579-1303-48d9-a227-7a8d95cdd44f req-863df21b-92ef-42ba-80b3-26389a59dcbf service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.329795 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c63a1579-1303-48d9-a227-7a8d95cdd44f req-863df21b-92ef-42ba-80b3-26389a59dcbf service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.354002 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-c63a1579-1303-48d9-a227-7a8d95cdd44f req-863df21b-92ef-42ba-80b3-26389a59dcbf service nova] Creating event network-changed:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:29:50.366411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-c63a1579-1303-48d9-a227-7a8d95cdd44f req-863df21b-92ef-42ba-80b3-26389a59dcbf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069414 Aug 30 04:29:50.367675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 280/542] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:50.901061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:50.902383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:50.910667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.911562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.912284 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.913418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.914539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.915219 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.982072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:50.982785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:50.998782 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.000756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.002519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.003446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.004910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.018325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.068562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:51.080642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7e1f5701-0a38-41ef-9d93-be302057eb9d tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1215 microversion: 2.1 time: 0.183397 Aug 30 04:29:51.082231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 263/543] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:50 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:51.107243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:51.108335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:51.126312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.127179 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.127835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.129012 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.130056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.131089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.362973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:51.373896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-196999e1-d1a1-4663-895a-94ae8c228472 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1712 microversion: 2.1 time: 0.396683 Aug 30 04:29:51.385489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 281/544] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:50 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1712 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:51.463895 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:51.472722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-380d08f9-7150-4316-93c2-ec5fa068e98f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.378329 Aug 30 04:29:51.489490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 264/545] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:51 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:52.118655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:52.122393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:52.149834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.150339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.154809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.158414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.160702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.161517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.377568 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:52.387036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc07a75b-fadd-4770-a382-e297651d7c02 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1271 microversion: 2.1 time: 0.282776 Aug 30 04:29:52.387658 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 282/546] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:52 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:52.472466 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-626211547"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:52.473137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:52.480231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.480920 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.481594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.482562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.483217 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.484201 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.501872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:52.502480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:52.511922 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.512535 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.513077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.513869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.514587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.515759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.765249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.network.security_group_api [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Adding security group 382602b1-b336-4adf-9199-bc2d0374f6be to port 25b90fd3-3c90-4049-8348-c086d7152285 Aug 30 04:29:52.839361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:52.851985 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-45693853-d3cc-454a-aa4c-81365a007aca tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.354079 Aug 30 04:29:52.858092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 283/547] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:52 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.409198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.410031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.426140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.428133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.429680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.431576 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1bb7e02e-db54-4abc-a7ae-ca2958e969bf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.963661 Aug 30 04:29:53.432099 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.432493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 265/548] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:29:52 2022] POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/action => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:53.436164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.436663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.443249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.444269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.455443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.457229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.457865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.461240 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.461890 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.462497 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.581398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.596300 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fb1d72e9-e575-4c0e-8d4b-2f2204c26db7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1277 microversion: 2.1 time: 0.192083 Aug 30 04:29:53.601322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 284/549] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.612138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-f759777c-543c-421f-8193-4f2036e32ac3 req-35966e56-342f-4661-a67c-6ba19fd04b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:53.713500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.714351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-f759777c-543c-421f-8193-4f2036e32ac3 req-35966e56-342f-4661-a67c-6ba19fd04b03 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.714781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-f759777c-543c-421f-8193-4f2036e32ac3 req-35966e56-342f-4661-a67c-6ba19fd04b03 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.715231 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-f759777c-543c-421f-8193-4f2036e32ac3 req-35966e56-342f-4661-a67c-6ba19fd04b03 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.724064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b36bd639-e5c8-4964-8a70-b300b653ba50 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1758 microversion: 2.1 time: 0.285492 Aug 30 04:29:53.724712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 266/550] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1758 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.749801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-f759777c-543c-421f-8193-4f2036e32ac3 req-35966e56-342f-4661-a67c-6ba19fd04b03 service nova] Creating event network-changed:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:29:53.755606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-f759777c-543c-421f-8193-4f2036e32ac3 req-35966e56-342f-4661-a67c-6ba19fd04b03 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152220 Aug 30 04:29:53.756690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 285/551] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:53.877942 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.878765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.880727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=62 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:53.887574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.888062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.888529 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.889276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.889751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.896816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.287062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:54.302781 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1cfc0d38-6e75-4b2c-af80-1f752c0ac468 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.428770 Aug 30 04:29:54.304425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 267/552] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:54.622387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:54.623446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:54.635570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.636512 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.639193 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.640273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.643953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.644660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.973648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:54.981303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-94103632-fca3-4878-a253-693849a26464 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.363165 Aug 30 04:29:54.981878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 286/553] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:54 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:55.247280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-9f0a034d-f40a-423c-b39c-04dcb73c233e req-d012ee0a-7cca-47a3-be73-a7180bbd455b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4906f812-d87f-4f5c-8488-ad14e01ba086", "tag": "c0091232-8ba1-49a4-82e0-5cba0a341a09"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:55.269885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9f0a034d-f40a-423c-b39c-04dcb73c233e req-d012ee0a-7cca-47a3-be73-a7180bbd455b service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.270703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9f0a034d-f40a-423c-b39c-04dcb73c233e req-d012ee0a-7cca-47a3-be73-a7180bbd455b service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.271439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9f0a034d-f40a-423c-b39c-04dcb73c233e req-d012ee0a-7cca-47a3-be73-a7180bbd455b service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.293146 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-9f0a034d-f40a-423c-b39c-04dcb73c233e req-d012ee0a-7cca-47a3-be73-a7180bbd455b service nova] Creating event network-changed:c0091232-8ba1-49a4-82e0-5cba0a341a09 for instance 4906f812-d87f-4f5c-8488-ad14e01ba086 on hv-cinder-85426 Aug 30 04:29:55.301008 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-9f0a034d-f40a-423c-b39c-04dcb73c233e req-d012ee0a-7cca-47a3-be73-a7180bbd455b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058227 Aug 30 04:29:55.302447 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 268/554] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:55.327485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:55.328500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.337366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.338018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.338563 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.339933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.340491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.341201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.428151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-99bf3b15-26dd-4bd8-862b-097b3c20e6d8 req-df48f9df-1c4e-457a-98b2-a1ba30e93ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1ca12d-df37-4d58-b819-0e4c7df8fc9b", "name": "network-vif-plugged", "status": "completed", "tag": "d21ea63a-d1d4-48e3-8e7e-276477e7b961"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:55.451466 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-99bf3b15-26dd-4bd8-862b-097b3c20e6d8 req-df48f9df-1c4e-457a-98b2-a1ba30e93ec4 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.454020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-99bf3b15-26dd-4bd8-862b-097b3c20e6d8 req-df48f9df-1c4e-457a-98b2-a1ba30e93ec4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.455467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-99bf3b15-26dd-4bd8-862b-097b3c20e6d8 req-df48f9df-1c4e-457a-98b2-a1ba30e93ec4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.479164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-99bf3b15-26dd-4bd8-862b-097b3c20e6d8 req-df48f9df-1c4e-457a-98b2-a1ba30e93ec4 service nova] Creating event network-vif-plugged:d21ea63a-d1d4-48e3-8e7e-276477e7b961 for instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b on hv-cinder-85426 Aug 30 04:29:55.487079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-99bf3b15-26dd-4bd8-862b-097b3c20e6d8 req-df48f9df-1c4e-457a-98b2-a1ba30e93ec4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068248 Aug 30 04:29:55.487684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 269/555] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:55.568126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.576711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6225dea3-8787-43d2-9579-ae5468ee7104 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.254392 Aug 30 04:29:55.578476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 287/556] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:55 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:56.003558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.004268 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.010455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.010937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.011363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.012047 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.012494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.012908 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.031712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:56.147036 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:56.154762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-02708530-279b-4eea-95ab-24b1a1c021eb tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.156051 Aug 30 04:29:56.155345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 270/557] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:55 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:56.276008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.276829 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.282787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.283270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.283705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.284435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.284887 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.285342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.308488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a417d4d8-cf55-4194-854b-210f2bbcce62 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/ips" status: 200 len: 152 microversion: 2.20 time: 0.036643 Aug 30 04:29:56.309060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 288/558] 10.222.0.85 () {60 vars in 1289 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:29:56.608341 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.608950 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.618281 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.618947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.619613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.620808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.621493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.622019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.755350 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:56.763037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-423aed11-303f-47df-8483-4691b1e8bcf8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.158467 Aug 30 04:29:56.763605 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 271/559] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:57.175661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.176297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.182238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.182741 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.183168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.183838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.184323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.184735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.323020 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.332260 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2ad0d79a-4fb3-47f6-a94b-1e6cfd644c81 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.160953 Aug 30 04:29:57.333320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 289/560] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:57.785932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.786633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.793366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.793848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.794279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.794964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.795417 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.795841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.928338 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.935833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9838b274-12f5-432f-b6b4-087f32020dfa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.153782 Aug 30 04:29:57.936395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 272/561] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:58.352236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.352852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.355572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.361766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.362516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.363001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.364255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.364255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.364604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.495503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:58.503050 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a52f27e7-809e-40f2-99c6-9f1496514d42 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.154771 Aug 30 04:29:58.503615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 290/562] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:58.956874 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.957499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.963724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.964211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.964638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.965364 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.965814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.966230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.102018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.110316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5fa90d64-d7d4-4be2-bfb0-f2670c655497 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.157345 Aug 30 04:29:59.111150 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 273/563] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:59.523716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.524343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.526237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=8 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:59.532860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.533381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.533843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.534547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.535004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.535437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.668434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.676321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7e5173d3-a6bd-4381-b7f9-862b62c21630 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.156415 Aug 30 04:29:59.676880 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 291/564] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:00.131603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:00.132207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.138878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.139362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.139829 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.140891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.141380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.141797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.274811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.282911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-555e3529-c3da-47c2-b753-eabe854e669e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1371 microversion: 2.1 time: 0.155148 Aug 30 04:30:00.296583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 274/565] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:00 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:00.697587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:00.698257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.706413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.707172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.707858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.708925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.709585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.710361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.741670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:00.742345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.751756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.752556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.753423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.754421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.755479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.756139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.811078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lazy-loading 'flavor' on Instance uuid 0eaa5682-d37f-4718-af65-77b66b3963b7 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:00.969773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.989411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1edf893a-2490-4fa9-b5e0-37f1c2a52432 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.295727 Aug 30 04:30:00.990427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 292/566] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:00 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:01.036152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52db9727-ced3-4258-82df-902a3536f561 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/action" status: 202 len: 0 microversion: 2.20 time: 0.299013 Aug 30 04:30:01.036752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 275/567] 10.222.0.85 () {62 vars in 1319 bytes} [Tue Aug 30 04:30:00 2022] POST /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:30:01.045121 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.046257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.049540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:01.057752 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.058470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.059195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.059789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.060487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.061235 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.204393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.212515 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.214125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.215380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fb838b4e-8692-49fe-9a0a-59c1f6596547 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.174094 Aug 30 04:30:01.216031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 293/568] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:01.305112 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.305738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.312466 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.312948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.313425 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.314109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.314557 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.314980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.443231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.450822 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2a6741d5-6062-434e-9bc4-7b31438bdf17 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1565 microversion: 2.1 time: 0.150539 Aug 30 04:30:01.451381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 276/569] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:01.471275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.471762 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.477727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.478220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.478647 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.479329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.479776 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.480192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.556558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ffc83aef-e0e2-4685-9772-cdcaa5d976c6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089032 Aug 30 04:30:01.557123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 294/570] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:02.012160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:02.012767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.018587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.019065 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.019491 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.020168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.020617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.021058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.240207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:02.241791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.248190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.248673 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.249200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.249904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.250350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.250767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.610352 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.618265 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-44546c63-3bad-4e40-97db-36a22fcf64e4 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.609900 Aug 30 04:30:02.618966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 277/571] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:02 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:02.662368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.670684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.672195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.673619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ab659dd0-bc54-478f-ad99-cab654718d92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.438006 Aug 30 04:30:02.674200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 295/572] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:02 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:03.020058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-d5bb394f-36c7-4928-ba17-63258abffa0f req-cf06bf3c-2880-44cf-be4f-7ae5a37ca518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1ca12d-df37-4d58-b819-0e4c7df8fc9b", "tag": "d21ea63a-d1d4-48e3-8e7e-276477e7b961"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:03.029323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d5bb394f-36c7-4928-ba17-63258abffa0f req-cf06bf3c-2880-44cf-be4f-7ae5a37ca518 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.029856 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d5bb394f-36c7-4928-ba17-63258abffa0f req-cf06bf3c-2880-44cf-be4f-7ae5a37ca518 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.030489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d5bb394f-36c7-4928-ba17-63258abffa0f req-cf06bf3c-2880-44cf-be4f-7ae5a37ca518 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.041295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-d5bb394f-36c7-4928-ba17-63258abffa0f req-cf06bf3c-2880-44cf-be4f-7ae5a37ca518 service nova] Creating event network-changed:d21ea63a-d1d4-48e3-8e7e-276477e7b961 for instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b on hv-cinder-85426 Aug 30 04:30:03.046657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-d5bb394f-36c7-4928-ba17-63258abffa0f req-cf06bf3c-2880-44cf-be4f-7ae5a37ca518 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029950 Aug 30 04:30:03.047233 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 278/573] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:03.437950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-b64d8c06-34f4-4086-81c2-8348040525b6 req-508bb734-dda5-4af7-9c64-7fc33fe17549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4906f812-d87f-4f5c-8488-ad14e01ba086", "name": "network-vif-plugged", "status": "completed", "tag": "c0091232-8ba1-49a4-82e0-5cba0a341a09"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:03.448013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b64d8c06-34f4-4086-81c2-8348040525b6 req-508bb734-dda5-4af7-9c64-7fc33fe17549 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.448936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b64d8c06-34f4-4086-81c2-8348040525b6 req-508bb734-dda5-4af7-9c64-7fc33fe17549 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.449828 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b64d8c06-34f4-4086-81c2-8348040525b6 req-508bb734-dda5-4af7-9c64-7fc33fe17549 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.462491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-b64d8c06-34f4-4086-81c2-8348040525b6 req-508bb734-dda5-4af7-9c64-7fc33fe17549 service nova] Creating event network-vif-plugged:c0091232-8ba1-49a4-82e0-5cba0a341a09 for instance 4906f812-d87f-4f5c-8488-ad14e01ba086 on hv-cinder-85426 Aug 30 04:30:03.468359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-b64d8c06-34f4-4086-81c2-8348040525b6 req-508bb734-dda5-4af7-9c64-7fc33fe17549 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Aug 30 04:30:03.469105 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 296/574] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:03.639991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.640694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.651314 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.651804 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.656234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.656990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.658713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.659166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.697153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.697868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.707276 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.707761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.712289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.713709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.714341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.714929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.031542 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.039902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1f25df1f-9512-4f6a-90a0-329320f9c8e6 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.404024 Aug 30 04:30:04.040132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.053655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 279/575] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:04.063570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.066093 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.067536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4e66e86d-6d6f-40e8-bd51-75c5b185a18a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.375104 Aug 30 04:30:04.067980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 297/576] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:05.060995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.061625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.067898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.068374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.068805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.069590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.070037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.070452 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.095564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.096263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.102611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.103097 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.103761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.104455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.105103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.105730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.264938 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.272427 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-adb9523b-2bf0-41a3-b248-b0862653e643 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.215261 Aug 30 04:30:05.273270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 280/577] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:05.288500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.290836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:05.297827 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.299238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.300380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1eb95372-69c3-4aab-8357-2a2b1c9bffde tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.209430 Aug 30 04:30:05.300928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 298/578] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:06.293558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.294175 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.301292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.301776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.302237 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.302930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.303397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.303814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.323039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.323798 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.330638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.331254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.331794 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.332614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.333213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.333776 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.506464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.514636 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-38323696-2cb0-44af-8f40-72832724da92 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1319 microversion: 2.1 time: 0.224790 Aug 30 04:30:06.515310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 281/579] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:06.519347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.528200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.529712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.531380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f0ec2ec8-07e1-44e1-9a20-62b3ee916110 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.212456 Aug 30 04:30:06.532794 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 299/580] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:07.540019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.540637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.547645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.548130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.548562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.549315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.549768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.550259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.555493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.556183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.562941 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.563678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.564229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.565183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.565782 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.566317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.751096 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.757936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.758882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7eb2095c-ea76-4c59-981f-8eff0f5c62b8 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1507 microversion: 2.1 time: 0.222842 Aug 30 04:30:07.759464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 282/581] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:07.766347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.767978 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:07.769256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f1f56f19-2de6-4be9-b033-9291d1fc1f49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.217882 Aug 30 04:30:07.769808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 300/582] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:07.781430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a5d511-fa81-4613-8e02-4d46ee612eb7", "device": "/dev/sdb"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:07.784253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.790269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.790746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.791176 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.791856 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.792304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.792725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.089324 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4b890143-7308-4bd8-96e6-7da53122e527 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "POST /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312018 Aug 30 04:30:08.089966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 283/583] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:30:07 2022] POST /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:08.791585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:08.792170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:08.798550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:08.799029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:08.799467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.800138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:08.800582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:08.800997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.935314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.943860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.945303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.946453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c282bbba-b44f-46a6-93dd-8b518aef52de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.158713 Aug 30 04:30:08.947008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 301/584] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:08 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:09.970733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.971368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.977472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.977948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.978372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.979045 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.979487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.979904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.998205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:10.112584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.121142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.122635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.124669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5ba206a8-cc99-4ce9-9932-adeb3ec881a5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.157923 Aug 30 04:30:10.125242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 284/585] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:11.148075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.148719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.155319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.155805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.156239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.156943 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.157432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.157865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.341668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.349948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.351453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.352702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-58b41450-aa7d-4191-9c24-0e41c259b91f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.208603 Aug 30 04:30:11.353868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 302/586] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:12.378506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.379216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.385873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.386394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.386827 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.387548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.387999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.388418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.520503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.528472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.530018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.531085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98ba97bf-1579-4434-939b-3779afb4e917 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.157759 Aug 30 04:30:12.532128 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 285/587] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:13.561313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:13.564768 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:13.572347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.572850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.573517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.574401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.574925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.575332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.711145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:13.719646 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:13.721229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:13.722420 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a5fa6968-9bef-4b7b-89b9-0fa5d04faebb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.169363 Aug 30 04:30:13.722975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 303/588] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:13 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:14.746301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:14.746929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:14.753745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.754220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.754645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.755316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.755752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.756162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.883815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.898278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.900047 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.901375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-78c5f751-e85f-4b93-99d7-8eb6c10c925e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.158717 Aug 30 04:30:14.901924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 286/589] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:14 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:15.924853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:15.925425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:15.931836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:15.932310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:15.932742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:15.933455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:15.933902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:15.934319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:16.064043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:16.072036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:16.073513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:16.074678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-416055a2-f9bb-41d7-8ba0-36ad7e199494 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.154267 Aug 30 04:30:16.075241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 304/590] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:15 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:17.097403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:17.098015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:17.104601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.105122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.105561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.106250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.106702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.107122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.238588 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.246786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.248213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.249396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0176d725-8498-44ea-84fc-95812c890dcd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.155965 Aug 30 04:30:17.249956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 287/591] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:17 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:18.273032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:18.273628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:18.279986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.280468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.280898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.281612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.282063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.282485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.409915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.417901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.419332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.420482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3980df89-ac70-4857-9795-266869ab046a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.151402 Aug 30 04:30:18.421031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 305/592] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:18 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:19.444863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:19.446245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:19.453022 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.453838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.454494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.455837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.456493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.456916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.596878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.605390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.606858 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.608046 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-043fcd99-074f-4eec-9aa4-4e003d9a057b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.168041 Aug 30 04:30:19.608592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 288/593] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:19 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:20.631571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.632185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.638643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.639129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.639561 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.640246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.640698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.641159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.767172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.775590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.777023 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.778251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bcb35e12-448f-41c4-aba3-9c2aa54cefb1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.151150 Aug 30 04:30:20.778809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 306/594] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:21.801365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:21.801912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:21.808290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.808766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.809242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.809918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.810365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.810782 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.935912 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:21.944482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:21.945944 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:21.947091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5adfabe8-0858-41a0-a295-529c6b3590b4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.150318 Aug 30 04:30:21.947641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 289/595] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:21 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:22.970178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:22.971292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:22.978448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.979045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.979520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.980468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.981110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.981903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.116070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.125178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.127375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:23.128547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-002d8db2-9106-45c4-84b8-02fae77cc50d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.162500 Aug 30 04:30:23.129124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 307/596] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:22 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:24.152063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.152676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.155288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=46 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:24.161444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.161966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.162403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.163102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.163552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.163972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.292115 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.301162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.302592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.303757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d8dd6db7-5267-4be0-9157-29e961c670e8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.155682 Aug 30 04:30:24.304300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 290/597] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:25.327529 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.328177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:25.335556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.336041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.336480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.337202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.337711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.338138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.492366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.500685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.502905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.504079 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c5f62db9-e366-4e97-b494-741abca617bc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.181219 Aug 30 04:30:25.504629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 308/598] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:25 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:26.526784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:26.527312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.533844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.534953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.535419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.536122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.536574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.536993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.671846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.679735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.681170 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.682348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-995b6969-2408-4069-ac00-7bbf3e8d61f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.159600 Aug 30 04:30:26.682899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 291/599] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:26 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:27.706472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:27.707064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:27.713777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.714265 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.714701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.715394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.715847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.716268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.847895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.855979 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.857449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.858612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dccfca33-cbe2-4f48-b3b3-1c6da6cd2907 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.156604 Aug 30 04:30:27.859174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 309/600] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:27 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:28.882172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.882785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.889630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.890115 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.890548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.891236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.891687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.892110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.019527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.027460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.028889 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.030067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b601243c-f3a2-48dc-a3fc-73532619cf6b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.151841 Aug 30 04:30:29.030621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 292/601] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:30.052981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:30.053556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:30.059955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.060429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.060853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.061573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.062019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.062447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.192233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:30.200277 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:30.201738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:30.202889 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2fbbd7dc-6a6c-467d-91a6-71b6f3b5f6f4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.153893 Aug 30 04:30:30.203440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 310/602] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:30 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:31.227632 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:31.228235 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:31.234564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.235034 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.235457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.236129 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.236568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.236979 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.369635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:31.377552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:31.378988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:31.380131 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6648e8b1-d72f-4154-890f-053cbfab0f2f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1745 microversion: 2.20 time: 0.157150 Aug 30 04:30:31.380688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 293/603] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:31 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:32.403301 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:32.403915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:32.406317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=36 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:32.411558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.412043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.412477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.413214 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.413669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.414094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.545028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.554014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.555583 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.556629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7dd86f17-0472-461d-9a5d-a36aa0ff9f44 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1745 microversion: 2.20 time: 0.157171 Aug 30 04:30:32.557208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 311/604] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:32 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:33.579314 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:33.579845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:33.586919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.587426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.587880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.588572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.589022 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.589514 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.720045 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.731508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.736034 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.737910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cbf20b8e-c6ab-45a9-987e-74e0aed3bc76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1745 microversion: 2.20 time: 0.162574 Aug 30 04:30:33.738471 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 294/605] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:33 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:34.761415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:34.762028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:34.768617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.769140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.769574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.770835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.771284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.771704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.773872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:34.774343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:34.780358 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.780828 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.781277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.781986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.782427 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.782840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.905175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:34.907748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lazy-loading 'services' on Instance uuid 4906f812-d87f-4f5c-8488-ad14e01ba086 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:34.913198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:34.914722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:34.915890 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89e08eb2-7aae-44f8-adfa-5cca1a7ee0e4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1745 microversion: 2.20 time: 0.158360 Aug 30 04:30:34.916454 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 312/606] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:34 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:35.022773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-22db436e-47c0-49bb-9036-64a3faea8593 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086/os-volume_attachments/23a5d511-fa81-4613-8e02-4d46ee612eb7" status: 202 len: 0 microversion: 2.1 time: 0.253487 Aug 30 04:30:35.023347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 295/607] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:30:34 2022] DELETE /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086/os-volume_attachments/23a5d511-fa81-4613-8e02-4d46ee612eb7 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:30:35.356487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-b0488192-ebbb-4e64-a390-2c093c036eab req-bdc62be7-f393-4499-a118-98f0f22ce6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "name": "network-vif-plugged", "status": "completed", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:35.367908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b0488192-ebbb-4e64-a390-2c093c036eab req-bdc62be7-f393-4499-a118-98f0f22ce6db service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.368479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b0488192-ebbb-4e64-a390-2c093c036eab req-bdc62be7-f393-4499-a118-98f0f22ce6db service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.368955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b0488192-ebbb-4e64-a390-2c093c036eab req-bdc62be7-f393-4499-a118-98f0f22ce6db service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.382387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-b0488192-ebbb-4e64-a390-2c093c036eab req-bdc62be7-f393-4499-a118-98f0f22ce6db service nova] Creating event network-vif-plugged:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:30:35.387484 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-b0488192-ebbb-4e64-a390-2c093c036eab req-bdc62be7-f393-4499-a118-98f0f22ce6db service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035088 Aug 30 04:30:35.388080 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 313/608] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:35.939382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:35.940086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:35.946323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.946809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.947245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.947934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.948383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.948804 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.084719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:36.094011 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:36.096040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:36.097373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cb2f3817-1f64-47c7-b730-18638fc2effd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1745 microversion: 2.20 time: 0.163115 Aug 30 04:30:36.107527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 296/609] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:35 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:37.121830 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.123205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:37.130219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.130983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.131635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.132408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.132933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.133444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.159638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=88 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:37.231644 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.232212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:37.241684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.242412 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.243406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.244108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.244891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.245467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.279922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:30:37.298999 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.311402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.313431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.314968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0b07c0a0-37f7-42ff-a5f1-54bc32285417 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.197383 Aug 30 04:30:37.325124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 314/610] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:37 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:37.382270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c44f3225-5264-47bb-bf27-c6313c905156 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 204 len: 0 microversion: 2.1 time: 0.158176 Aug 30 04:30:37.383325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 297/611] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:37 2022] DELETE /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:37.392513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.396187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:37.404589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.405539 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.406305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.407121 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.407683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.408245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.561383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.570964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6015428f-b495-4c0c-9b5c-f3288e5a4f26 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1513 microversion: 2.1 time: 0.183312 Aug 30 04:30:37.571894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 315/612] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:37 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:38.340047 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:38.340918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:38.347374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.347885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.348313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.348996 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.349480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.350105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.512402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:38.517245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:38.523601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:38.525201 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:38.526362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-14fefa6e-8792-426a-ad76-d9c31e775129 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.190804 Aug 30 04:30:38.527096 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 298/613] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:38 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:38.599428 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:38.600873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:38.607957 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.608546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.609092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.609863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.610387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.610884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.754036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:38.761717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ad98acd3-b2fa-4390-bf29-1965566ad0f3 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1513 microversion: 2.1 time: 0.166730 Aug 30 04:30:38.762355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 316/614] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:38 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:39.552916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:39.553734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:39.560966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:39.561615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:39.562352 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:39.563054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:39.563539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:39.563964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:39.710152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.720928 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.722443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.723629 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-908c8269-2481-4bfb-ac28-60527d7e1646 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.175593 Aug 30 04:30:39.724172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 299/615] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:39 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:39.786152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:39.787392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:39.794153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:39.794627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:39.795060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:39.795740 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:39.796186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:39.796601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:39.940765 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.950323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-716c8be7-6ee8-42cd-b452-b00df186c3ad tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1513 microversion: 2.1 time: 0.168117 Aug 30 04:30:39.951226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 317/616] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:39 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:40.748590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:40.749267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:40.759633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.760746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.761438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.762442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.763257 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.763966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.976526 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:40.980426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:40.991663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.992412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.993028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.993980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.994655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.995432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.153918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:41.167592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:41.171930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:41.183347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e3b67ca6-7556-4279-afd1-0d887505512a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.428802 Aug 30 04:30:41.183347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 300/617] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:40 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:41.663058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:41.679763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1a3fb4b1-a96a-41c2-82bd-75daf198a6b7 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1513 microversion: 2.1 time: 0.711578 Aug 30 04:30:41.693919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 318/618] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:40 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1513 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:42.089382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a7871461-d797-4669-bfa8-ba9d4dda553d req-caba0452-0aa9-465d-a89e-a7a42c7f0c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4906f812-d87f-4f5c-8488-ad14e01ba086", "name": "network-vif-deleted", "tag": "c0091232-8ba1-49a4-82e0-5cba0a341a09"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:42.108985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a7871461-d797-4669-bfa8-ba9d4dda553d req-caba0452-0aa9-465d-a89e-a7a42c7f0c1c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.109338 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a7871461-d797-4669-bfa8-ba9d4dda553d req-caba0452-0aa9-465d-a89e-a7a42c7f0c1c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.111754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a7871461-d797-4669-bfa8-ba9d4dda553d req-caba0452-0aa9-465d-a89e-a7a42c7f0c1c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.143877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a7871461-d797-4669-bfa8-ba9d4dda553d req-caba0452-0aa9-465d-a89e-a7a42c7f0c1c service nova] Creating event network-vif-deleted:c0091232-8ba1-49a4-82e0-5cba0a341a09 for instance 4906f812-d87f-4f5c-8488-ad14e01ba086 on hv-cinder-85426 Aug 30 04:30:42.151177 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a7871461-d797-4669-bfa8-ba9d4dda553d req-caba0452-0aa9-465d-a89e-a7a42c7f0c1c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069278 Aug 30 04:30:42.153297 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 301/619] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:42.198125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:42.199301 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:42.206365 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.206862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.207326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.208237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.208689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.209383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.422022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:42.437455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:42.439503 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:42.440949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e626612d-952d-4f77-8043-a543e7fb8afb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.248065 Aug 30 04:30:42.442075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 319/620] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:42 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:42.703021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:42.704010 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:42.726033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.727623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.729006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.731390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.733245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.733922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.779643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.781275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.781757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.782224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lazy-loading 'fault' on Instance uuid 4906f812-d87f-4f5c-8488-ad14e01ba086 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:42.838679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a25d172babb4cd698fac79d7412d25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8842fc1da94bf681eeb42464032b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:42.849099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8589d3c7-4f6e-4def-b70e-6493894b3788 tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 200 len: 1309 microversion: 2.1 time: 0.149105 Aug 30 04:30:42.874898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 302/621] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:42 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:43.467444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:43.468072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:43.482791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.485711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.486334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.487216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.489091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.492280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.678476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.688328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.690728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.692391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-571bdf08-f89a-4eb3-8e9a-1edd1ee2e4ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.232281 Aug 30 04:30:43.693071 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 320/622] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:43 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:43.870684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:43.872033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] [instance: 4906f812-d87f-4f5c-8488-ad14e01ba086] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:43.881422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.882344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.883028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.883895 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.884367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.884784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.903697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] HTTP exception thrown: Instance 4906f812-d87f-4f5c-8488-ad14e01ba086 could not be found. Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Request method failure captured: Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 HTTP/1.1 Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZGlN85o103sdJFthfSABaJO4xmGsoHiF7tiGzz-4hFXG82i1z9PsMM_BQ3rDijTNfQ3UgWaKwugIPeLXTVsmyC5aZs511liV3u4fJ8TzW-MS3MoK2iYOut5pzF3nWG0DrkAATXvdnuZHu2b1A6hwplDwWrnC-6L_6oyozO3uJiWCFM Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 2d8842fc1da94bf681eeb42464032b8a Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1380366567 Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:30:43.905540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2d8842fc1da94bf681eeb42464032b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2d8842fc1da94bf681eeb42464032b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2d8842fc1da94bf681eeb42464032b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2d8842fc1da94bf681eeb42464032b8a"}]}] Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1380366567 Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 2d8842fc1da94bf681eeb42464032b8a Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1380366567 Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesSnapshotTestJSON-1380366567-project Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 3a25d172babb4cd698fac79d7412d25b Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1380366567-project Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 4906f812-d87f-4f5c-8488-ad14e01ba086 could not be found. Aug 30 04:30:43.906859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '4906f812-d87f-4f5c-8488-ad14e01ba086'} Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4906f812-d87f-4f5c-8488-ad14e01ba086 could not be found. Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:43.907591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4906f812-d87f-4f5c-8488-ad14e01ba086 could not be found. Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4906f812-d87f-4f5c-8488-ad14e01ba086 could not be found. Aug 30 04:30:43.910243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:30:43.912164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] Returning 404 to user: Instance 4906f812-d87f-4f5c-8488-ad14e01ba086 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:43.912164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fa7c8e2e-327c-4d30-ab61-d05054fe335b tempest-VolumesSnapshotTestJSON-1380366567 tempest-VolumesSnapshotTestJSON-1380366567-project] 10.222.0.85 "GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086" status: 404 len: 111 microversion: 2.1 time: 0.041352 Aug 30 04:30:43.912164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 303/623] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:43 2022] GET /compute/v2.1/servers/4906f812-d87f-4f5c-8488-ad14e01ba086 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:44.717962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:44.721305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:44.729722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.730705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.731358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:44.732076 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.732534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.732963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:44.917905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:44.927519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:44.929319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:44.930660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-75060b89-6cf2-440c-b6bd-e40f46216b09 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.218742 Aug 30 04:30:44.931274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 321/624] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:44 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:45.954175 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:45.955554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:45.963934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.964776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.965503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.966426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.967295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.968261 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.104691 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:46.113315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:46.114830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:46.116296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e36164e3-8f62-4fe6-ac8e-f74a5f628373 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.166003 Aug 30 04:30:46.117087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 304/625] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:45 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:47.139845 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:47.140455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:47.147038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.147519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.147948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.148647 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.149246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.149668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.286399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.294964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.296430 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.297866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-540ab444-8904-419e-9696-1a8fe3cc9aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.162041 Aug 30 04:30:47.298427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 322/626] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:47 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:48.321683 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:48.322326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:48.328888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.329476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.330020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.330713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.331164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.331581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.467650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.476163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.477638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.478786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-60dce6c4-4b96-4dda-8370-1fadb72fd36c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.161006 Aug 30 04:30:48.479334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 305/627] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:48 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:49.502569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:49.503187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:49.510628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.511114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.511550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.512330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.513069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.513233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.638989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.647438 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.649182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.650373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-976c4e67-7746-4031-bfcf-e6c10de3f879 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1740 microversion: 2.20 time: 0.151712 Aug 30 04:30:49.650932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 323/628] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:49 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:50.673274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.673881 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.680667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.681175 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.681604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.682317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.682758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.683197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.815688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.824601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.826082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.827238 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cebff865-d426-4851-946e-c3015e21c99b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1722 microversion: 2.20 time: 0.157952 Aug 30 04:30:50.827794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 306/629] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:51.851614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:51.852224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:51.858458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.858938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.859363 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.860045 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.860497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.860960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.989413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:51.998403 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:51.999852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:52.001196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e24dea51-3f2f-45f6-9188-1b19a6944958 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1722 microversion: 2.20 time: 0.154020 Aug 30 04:30:52.001896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 324/630] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:51 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:52.888182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:52.890448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:52.896496 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.896966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.897430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.898103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.898541 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.898955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.968749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bb37fa65-064a-41e4-b09f-1422c9675ba1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.084237 Aug 30 04:30:52.969581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 307/631] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:30:52 2022] POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:30:52.978064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:52.978764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:52.985584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.986114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.986491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.987224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.987622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.988106 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.024741 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:53.025467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:53.031996 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.032477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.032909 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.033626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.034076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.034496 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.187456 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.195654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cf9a3559-5f29-4818-827f-e73daece994f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1750 microversion: 2.1 time: 0.221460 Aug 30 04:30:53.196258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 325/632] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:52 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:53.210683 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.218696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.220125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.221299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3c066682-590c-4873-8570-24d8e13e33d8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1722 microversion: 2.20 time: 0.200815 Aug 30 04:30:53.221840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 308/633] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:53 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:53.399285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-278b45ee-5752-4a36-a102-4ba5bd0c7734 req-6ceca2e4-7d68-4e62-acb9-30d1a9b947eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "name": "network-vif-unplugged", "status": "completed", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:53.408920 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-278b45ee-5752-4a36-a102-4ba5bd0c7734 req-6ceca2e4-7d68-4e62-acb9-30d1a9b947eb service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.409502 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-278b45ee-5752-4a36-a102-4ba5bd0c7734 req-6ceca2e4-7d68-4e62-acb9-30d1a9b947eb service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.410467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-278b45ee-5752-4a36-a102-4ba5bd0c7734 req-6ceca2e4-7d68-4e62-acb9-30d1a9b947eb service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.421586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-278b45ee-5752-4a36-a102-4ba5bd0c7734 req-6ceca2e4-7d68-4e62-acb9-30d1a9b947eb service nova] Creating event network-vif-unplugged:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:30:53.426476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-278b45ee-5752-4a36-a102-4ba5bd0c7734 req-6ceca2e4-7d68-4e62-acb9-30d1a9b947eb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030833 Aug 30 04:30:53.427217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 326/634] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:54.217087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.217729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.220152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:54.226528 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.227007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.227436 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.228121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.228568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.228989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.245373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.246118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.252657 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.253183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.254145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.254863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.255358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.255783 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.433517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.442162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.442636 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.443605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.444951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c9950920-018d-439b-a303-92082c554cbf tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1725 microversion: 2.20 time: 0.204889 Aug 30 04:30:54.445547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 327/635] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:54.451024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-06acfe7b-45a1-4779-ab08-b457e5b022e1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1750 microversion: 2.1 time: 0.237843 Aug 30 04:30:54.451580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 309/636] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:54.467306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7174293a-ea73-4e6e-8e44-491cdca4c650"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:54.469581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.475332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.475810 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.476234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.476912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.477390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.477807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.745716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:54.756170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4fcd71a6-dbef-4c0f-ac0f-816f62083728 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292775 Aug 30 04:30:54.756773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 328/637] 10.222.0.85 () {62 vars in 1364 bytes} [Tue Aug 30 04:30:54 2022] POST /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:30:54.876402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:54.877001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.883491 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.883974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.884405 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.885120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.885579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.886016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.927860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120715) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:30:54.992901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [b9481962-21dd-4adf-a5a3-11bf2134f431] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:30:55.472871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:55.473549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:55.481818 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.482307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.482747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.483441 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.483900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.484327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.621736 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:55.630190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4eed4fd6-aef6-4385-9372-39f6e51ea953 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1750 microversion: 2.1 time: 0.161853 Aug 30 04:30:55.630761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 329/638] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:55 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:56.000076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO oslo.messaging._drivers.impl_rabbit [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [b9481962-21dd-4adf-a5a3-11bf2134f431] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 46068. Aug 30 04:30:56.003285 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-59df86d5-ba5b-4b4f-87f1-736ec01ad632 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/action" status: 202 len: 0 microversion: 2.20 time: 1.130843 Aug 30 04:30:56.004502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 310/639] 10.222.0.85 () {62 vars in 1319 bytes} [Tue Aug 30 04:30:54 2022] POST /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:56.012433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.013062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.022267 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.022910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.023353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.024052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.024500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.024930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.170242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.179168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.180823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.182010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ca325f2-cd58-44d4-bf5a-d59159871cff tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1811 microversion: 2.20 time: 0.173446 Aug 30 04:30:56.182558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 330/640] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:56.651773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.652383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.658621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.659105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.660039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.660753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.661233 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.661653 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.814066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.822721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f0284a26-bea4-4634-8b06-6f44a4419556 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1750 microversion: 2.1 time: 0.175349 Aug 30 04:30:56.823280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 311/641] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:57.205488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:57.206100 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:57.213113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.213599 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.214034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.214722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.215175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.215598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.342322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:57.350788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:57.352245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:57.353437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-598edea2-eec6-4a45-b91e-4a18a50b334b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1811 microversion: 2.20 time: 0.151910 Aug 30 04:30:57.353995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 331/642] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:57 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:57.843546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:57.844094 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:57.850394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.850867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.851291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.851959 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.852401 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.852812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.002579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.011650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ed41c0c5-09f2-4f35-8c6e-dcb892d866a0 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.172227 Aug 30 04:30:58.012206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 312/643] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:57 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:58.377524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:58.379487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:58.387796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:58.388525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:58.389207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.389987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:58.390613 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:58.391182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.528952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.537961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.539377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.540521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f7038cce-0bad-4c2a-b7c8-7df1673e1a7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1753 microversion: 2.20 time: 0.168628 Aug 30 04:30:58.541083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 332/644] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:58 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:59.033326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.033924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.040230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.040705 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.041164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.041839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.042277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.042690 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.185112 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.194140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1c77cf61-b8f9-434b-8817-0f5ebe656c80 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.164681 Aug 30 04:30:59.194777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 313/645] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:59.563873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.564520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.571391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.571873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.572304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.572991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.573493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.573913 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.704477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.713132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.714574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.715747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-97222b0e-1b8b-48cd-bf7e-2b6604f39aac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1753 microversion: 2.20 time: 0.156878 Aug 30 04:30:59.716308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 333/646] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:00.215726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:00.216334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:00.223493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.223971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.224399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.225141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.225594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.226016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.244394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:00.380704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.389138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8d3f3171-c03a-471f-8505-e63f953ee52d tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.177248 Aug 30 04:31:00.389682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 314/647] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:00 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:00.738725 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:00.739359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:00.746009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.747110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.747562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.748430 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.748892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.749349 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.940019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.948806 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.950255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.951433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-39beb5d0-7bbd-47e4-9556-7ad654febd28 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.216653 Aug 30 04:31:00.952000 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 334/648] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:00 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:01.411206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.411736 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.418264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.418770 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.419205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.419891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.420337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.420755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.567058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.575295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d138b390-3fa6-4f1b-abff-106a97667936 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.168805 Aug 30 04:31:01.575850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 315/649] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:01.977109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.979478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.987637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.989159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.990067 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.990995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.992091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.992723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.166306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.177802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.179343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.180587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-da862bd4-4ac4-4819-889f-27c171bfa659 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.209158 Aug 30 04:31:02.181618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 335/650] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:02.596533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:02.597792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:02.604348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.604828 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.605365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.606124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.606568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.606984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.751369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.759957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3704b18a-8563-440a-989a-d87c6cb35ef3 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.167311 Aug 30 04:31:02.760537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 316/651] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:02 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:03.206095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:03.207229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:03.209719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=50 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:03.215256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.215770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.216443 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.217172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.217626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.218048 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.367399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.377090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.379102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.380281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-28f57a1c-aac5-4f71-8ad5-ee60603fe8c2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.178232 Aug 30 04:31:03.380842 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 336/652] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:03 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:03.781004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:03.781631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:03.788443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.789062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.789530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.790214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.790684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.791107 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.935435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.944291 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7aee81d7-e211-4f55-b95b-a88b3d9c6edb tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.167167 Aug 30 04:31:03.944854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 317/653] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:03 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:04.404816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:04.405579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:04.412593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.413058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.413504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.414203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.414648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.415153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.552192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.561187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.562617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.563774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ccb161a-1e25-4f02-9bb7-5ad80925d746 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.163093 Aug 30 04:31:04.564397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 337/654] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:04 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:04.969000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:04.970600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:04.978288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.978809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.979274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.979980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.980430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.980895 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.135367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.144258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0b5b251b-bcf5-4585-ae0d-26081d4b6e1c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.181019 Aug 30 04:31:05.144842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 318/655] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:04 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:05.588433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.589200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:05.595883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.596370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.596808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.597598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.598035 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.598460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.737058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.746314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.747719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.748887 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2a6ffe03-12bb-4359-8c4b-48f1d3b76f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.164394 Aug 30 04:31:05.749473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 338/656] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:06.165956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.166563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.173030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.173541 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.174091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.174777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.175789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.176212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.348254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.363788 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-250a5ea9-0e54-4cbe-8c12-f3564b692497 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.201554 Aug 30 04:31:06.364320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 319/657] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:06.773635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.774630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.781340 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.781877 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.782502 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.783061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.783660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.783765 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.945134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.955092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.957726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.959099 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3dcd97c9-cfb7-4fa0-bdc6-0f9db148b2cb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.190657 Aug 30 04:31:06.959665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 339/658] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:07.385411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:07.386069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:07.392372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.392854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.393329 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.394075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.394513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.394931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.557249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:07.574135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b9b2d6cb-1075-4745-85ff-0b2fb90dcf6c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.192606 Aug 30 04:31:07.579834 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 320/659] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:07 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:07.982694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:07.983323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:07.990519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.991006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.991459 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.992133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.992587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.993012 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.147316 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.156777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.158389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.160162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9a296ce5-c40f-4ff6-8edc-93a40b5ca6d4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.180882 Aug 30 04:31:08.160728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 340/660] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:07 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:08.595840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:08.597155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:08.603877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.604353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.604784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.605598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.606050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.606579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.758649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.767154 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ff804764-1e50-420e-90b5-ab22f577d2c8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.175103 Aug 30 04:31:08.781379 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 321/661] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:08 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:09.185270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.186521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.195952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.198698 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.199362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.200284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.200938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.201399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.356751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.366756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.368329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.369545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-21c88a8b-6b66-4970-9a75-ab6c84a0e380 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.190344 Aug 30 04:31:09.370242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 341/662] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:09.788716 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.789361 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.795622 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.796153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.796589 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.797299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.797740 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.798152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.946457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.958264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b0792bff-6bd7-4028-a874-94148ac30950 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.173446 Aug 30 04:31:09.972050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 322/663] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:10.397343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:10.398527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:10.405524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.406015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.406458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.407160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.407615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.408037 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.555274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:10.564726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:10.566240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:10.567542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-93679e92-51f3-40c7-b609-69318f68c841 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.175235 Aug 30 04:31:10.568107 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 342/664] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:10 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:10.979535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:10.980180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:10.986749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.987739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.988184 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.988872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.989768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.990328 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.135074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.143167 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-20568ec5-08af-4c1c-aae5-9b3dd2efe0a1 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.167440 Aug 30 04:31:11.143764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 323/665] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:10 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:11.591307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:11.591926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:11.599288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.599869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.600305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.601007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.601490 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.601913 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.740386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.749686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.751422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.752853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1193a20-f675-4a33-9eb3-53adab36d7dd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.165556 Aug 30 04:31:11.753449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 343/666] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:11 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:12.165302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:12.166056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:12.173030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.173620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.174058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.174784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.175237 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.175652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.324281 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.333774 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1d64a60c-ee69-4869-8039-cce434a62cab tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.173149 Aug 30 04:31:12.334359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 324/667] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:12 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:12.775579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:12.776366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:12.784254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.785133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.785838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.786912 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.787717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.788917 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.930417 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.939130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.941234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.942403 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-03918bd1-b8f3-4176-81ad-05e1f5757327 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.170784 Aug 30 04:31:12.942966 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 344/668] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:12 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:13.355373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:13.355998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:13.364267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.365009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.365459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.366148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.366587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.366997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.519869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:13.529347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cdce97cf-6f31-457e-85f8-cc7c69256932 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.178545 Aug 30 04:31:13.530068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 325/669] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:13 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:13.965532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:13.966151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:13.972738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.973262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.973703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.974394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.974844 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.975268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.990300 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:14.258366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.266740 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.268153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.269391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4fa6a51e-52da-4932-85dd-2e934b062f92 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.307700 Aug 30 04:31:14.269946 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 345/670] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:13 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:14.551165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:14.551707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:14.558083 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.558561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.559007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.559669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.560114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.560531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.748782 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.756970 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6668649c-f69e-4539-86aa-485859b2baa8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.210402 Aug 30 04:31:14.757554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 326/671] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:14 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:15.291779 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:15.292389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:15.298832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.299306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.299733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.300418 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.300870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.301326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.428548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.437472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.438908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.440072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9cda86a0-09ba-4d1c-9cd3-d0c758050b40 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.152279 Aug 30 04:31:15.441201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 346/672] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:15 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:15.778377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:15.778994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:15.785406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.785891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.786330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.787015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.787467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.787888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.930046 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.938095 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b17c4a20-7301-4479-817a-2b6038c86292 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.163935 Aug 30 04:31:15.938656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 327/673] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:15 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:16.463636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:16.464269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.470700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.471181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.472173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.472854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.473333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.473751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.598789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:16.607287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:16.608727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:16.609929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ea03bf73-d1a0-418f-aad5-deeb35bad69c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.150216 Aug 30 04:31:16.610494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 347/674] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:16 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:16.960525 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:16.961168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.967503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.967989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.968422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.969187 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.969641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.970063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.106397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:17.115550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-594debb9-d0a6-4f94-baef-a1b7fc431154 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.159571 Aug 30 04:31:17.116116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 328/675] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:16 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:17.633087 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:17.633619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:17.639939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.640447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.640878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.641609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.642060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.642479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.994419 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.002961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.004399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.005633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d3b359f0-b897-4ef1-9639-38aea26d1e60 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.376537 Aug 30 04:31:18.006198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 348/676] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:17 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:18.137126 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:18.137744 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:18.144594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.145099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.145626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.146276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.146724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.147144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.286092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.294390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dcfe3f74-53b9-4bd1-8e02-71ef84ef0344 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.161133 Aug 30 04:31:18.294949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 329/677] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:18 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:19.028890 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:19.029549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:19.036475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.036959 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.037423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.038109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.038563 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.038986 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.166732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.176022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.177521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.178705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f3cf7959-0e3b-481a-8618-a023e6885020 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.153757 Aug 30 04:31:19.179285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 349/678] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:19 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:19.315693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:19.316331 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:19.322800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.323277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.323709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.324384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.324831 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.325279 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.464916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.473711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a7677d0e-cbd7-41e9-808e-ed49dcea8582 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.161972 Aug 30 04:31:19.474277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 330/679] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:19 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:20.201722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:20.202340 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:20.208748 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.209270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.209706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.210402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.210856 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.211281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.339540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.347928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.349412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.350572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-721a0108-c7f7-4afd-b52e-b7cd1cf4cc7d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.152736 Aug 30 04:31:20.351131 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 350/680] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:20 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:20.494579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:20.495206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:20.508776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.509280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.509704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.510374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.510840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.511250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.515078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:20.544200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:20.544691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:20.551336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.551821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.552270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.552963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.553446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.553872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.638721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lazy-loading 'services' on Instance uuid 3d93d3bc-5adc-40f9-b372-b24ded320831 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:31:20.653384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.662252 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3b4e5b5b-9a2d-4af5-b8d5-714712c45f26 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1755 microversion: 2.1 time: 0.171347 Aug 30 04:31:20.662729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 331/681] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:20 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:20.707937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-471242f1-b8eb-42f6-a595-f46ff7be7335 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-volume_attachments/d6e49d7b-a891-4b19-a519-dcdb856ebda0" status: 202 len: 0 microversion: 2.1 time: 0.167421 Aug 30 04:31:20.708516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 351/682] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:31:20 2022] DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-volume_attachments/d6e49d7b-a891-4b19-a519-dcdb856ebda0 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:31:21.374340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:21.374867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:21.381314 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.381793 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.382222 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.382894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.383337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.383753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.516994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.526284 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.527710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.528849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-947834df-a07d-4355-80c8-a7e45edb4c49 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.158589 Aug 30 04:31:21.529442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 332/683] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:21 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:21.684350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:21.685084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:21.692016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.692499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.692935 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.693663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.694114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.694538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.835796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.844156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-de60c054-ee75-4ecf-86f9-693376a09b2e tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1758 microversion: 2.1 time: 0.164501 Aug 30 04:31:21.844724 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 352/684] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:21 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:22.553354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:22.553972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:22.560583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.561088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.561526 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.562210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.562662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.563083 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.689638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.698135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.699569 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.700710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-06016acc-be96-4123-8824-407d69083bd0 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.151961 Aug 30 04:31:22.701305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 333/685] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:22 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:23.724361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.724978 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.731767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.732285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.733068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.733436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.733893 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.734321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.871327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.879747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.881246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.882415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-117c427e-34dc-473a-bffe-77d3f866392e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.162569 Aug 30 04:31:23.882980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 353/686] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:24.905894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:24.906456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:24.909124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:24.914133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.914616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.915044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.915719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.916165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.916583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.043601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.052997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.054441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.055593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-47c30bdd-97d1-411e-bb96-ddb37305f52c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.153751 Aug 30 04:31:25.056142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 334/687] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:24 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:25.903015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af8f1bcc-c0d4-4583-b38a-acf8f47cf62f"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:25.905427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:25.911468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.911961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:25.912402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.913130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.913589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:25.914011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.077987 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.078615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.087111 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.087694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.088296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.089198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.089749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.090181 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.259876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:26.268532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:26.270000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:26.271154 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-37e50285-6624-4468-92de-55080df43255 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.197236 Aug 30 04:31:26.271708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 335/688] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:26.341204 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4cd3455f-9652-4b87-b89d-612fb7af8fa0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562767 Aug 30 04:31:26.341853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 354/689] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:31:25 2022] POST /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:27.246085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6cd1705b-bfe1-4049-a29a-496b66a504a3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:27.252499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6cd1705b-bfe1-4049-a29a-496b66a504a3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.252981 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6cd1705b-bfe1-4049-a29a-496b66a504a3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.253940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6cd1705b-bfe1-4049-a29a-496b66a504a3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.276741 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6cd1705b-bfe1-4049-a29a-496b66a504a3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Going to try to stop instance {{(pid=120715) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:31:27.297226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:27.297937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:27.304713 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.305364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.305791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.306498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.306954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.307378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.321838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6cd1705b-bfe1-4049-a29a-496b66a504a3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action" status: 202 len: 0 microversion: 2.1 time: 0.079445 Aug 30 04:31:27.322432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 336/690] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:27 2022] POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:31:27.332336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:27.333158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:27.339678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.340930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.341449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.342707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.343543 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.344298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.491737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.500293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.501778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.502960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b7587481-5e77-4e65-9757-f9bde8dd8688 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.211262 Aug 30 04:31:27.504016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 355/691] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:27 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:27.522207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.530074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-97f568ed-fb2e-4937-8b51-8f28bbf29836 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.203145 Aug 30 04:31:27.530641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 337/692] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:27 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:28.526098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.526714 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.533155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.533641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.534073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.535433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.535891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.536314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.550378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.551166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.557670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.558153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.558616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.559323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.559771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.560195 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.722758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.731437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.732883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.734090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ea1d47a1-8e43-4b11-948e-bbf51eecd07e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.211890 Aug 30 04:31:28.734684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 356/693] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:28.739312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.746973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-99790131-56ec-446a-94f8-57f76427e996 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.200408 Aug 30 04:31:28.747531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 338/694] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:29.757925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.758548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.765341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.765773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.766214 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.766908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.767364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.767788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.767884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.768504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.775198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.775722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.776245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.777102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.777582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.778002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.961584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.966170 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.972655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.974281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.974696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-afcc8ca2-3320-4b8e-b354-e0be5beebe19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.210527 Aug 30 04:31:29.975536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e12a3a28-bb4c-48e5-90f7-8aca8f60e145 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.221487 Aug 30 04:31:29.976097 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 357/695] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:29.983535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 339/696] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:30.995820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:30.996469 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:30.998746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:30.999360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:31.003026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.003512 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.003943 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.004636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.005112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.005536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.005863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.006341 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.006764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.007439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.007878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.008290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.202194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.209444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.211583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.213069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.214508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0d8186be-d024-4cad-bc2d-47049f486f02 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.219592 Aug 30 04:31:31.215282 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 340/697] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:30 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:31.229206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2ebea563-bd87-4097-bc2f-43be995f9784 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.226007 Aug 30 04:31:31.229206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 358/698] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:30 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:32.239554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.240169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.240267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.240814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.246606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.247089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.247222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.247523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.247642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.247983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.248214 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.248664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.248761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.249112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.249210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.249552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.439528 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.446927 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.448412 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d19da441-7b5f-4ac5-a80e-a6b8b396c904 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.212745 Aug 30 04:31:32.449078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 341/699] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:32.455449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.456879 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.458079 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-17442659-41ae-42b8-90e0-d2356b7e072c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.223256 Aug 30 04:31:32.458624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 359/700] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:33.470001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:33.470607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:33.478202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.478704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.479135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.479834 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.480292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.480713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.480999 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:33.481631 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:33.484006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=48 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:33.489608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.490117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.490544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.491231 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.491800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.492222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.495165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:33.682719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.685595 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.691253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bb842d82-e334-45c5-9ce8-220c89d2ee5d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.224480 Aug 30 04:31:33.691840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 342/701] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:33 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:33.694790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.696219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.697409 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-64aa628f-1548-4bf9-ba24-89046e1ae099 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.220157 Aug 30 04:31:33.697959 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 360/702] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:33 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:33.956193 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-f9b24c26-0e6e-4d05-9c04-1fc2b0c165f8 req-e7ff776c-44be-4f5b-bca1-4c63bd98f45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "name": "network-vif-plugged", "status": "completed", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:33.967815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f9b24c26-0e6e-4d05-9c04-1fc2b0c165f8 req-e7ff776c-44be-4f5b-bca1-4c63bd98f45a service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.968384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f9b24c26-0e6e-4d05-9c04-1fc2b0c165f8 req-e7ff776c-44be-4f5b-bca1-4c63bd98f45a service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.968819 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f9b24c26-0e6e-4d05-9c04-1fc2b0c165f8 req-e7ff776c-44be-4f5b-bca1-4c63bd98f45a service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.983586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-f9b24c26-0e6e-4d05-9c04-1fc2b0c165f8 req-e7ff776c-44be-4f5b-bca1-4c63bd98f45a service nova] Creating event network-vif-plugged:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:31:33.989754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-f9b24c26-0e6e-4d05-9c04-1fc2b0c165f8 req-e7ff776c-44be-4f5b-bca1-4c63bd98f45a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037477 Aug 30 04:31:33.990280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 343/703] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:34.714200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:34.714200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.719976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.720460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.720957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:34.721449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.721699 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.722544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.722797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.723223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.729455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.729947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.730381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.731076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.731709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.732136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.964558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:34.967676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:34.972422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7f98145f-6374-41dc-ba2e-4f04c4f6c97f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.263125 Aug 30 04:31:34.972997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 361/704] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:34 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:34.976672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:34.978262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:34.978423 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:34.979683 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c8cf743c-f978-4436-b9ce-7bdac6fe1573 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.263596 Aug 30 04:31:34.980431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 344/705] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:34 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:34.980625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.986774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.987263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.987704 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.988440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.989172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.989641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.012134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'flavor' on Instance uuid 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:31:35.166982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-12d5d744-fe85-4b97-a7a3-cce90aa3c602 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/action" status: 200 len: 32 microversion: 2.1 time: 0.192385 Aug 30 04:31:35.167507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 362/706] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:34 2022] POST /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:31:35.177303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:35.177998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:35.184011 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.184498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.184933 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.185645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.186098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.186520 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.316461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:35.324615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-45a8d4b8-cd3a-4746-928a-346d7bbb53a7 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.151632 Aug 30 04:31:35.325206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 345/707] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:35 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:35.994885 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:35.996228 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.001948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:36.003107 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.003341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.003837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.004273 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.004964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.005715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.006134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.009711 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.010194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.010628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.011323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.011839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.012263 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.287317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.292158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.295145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-271c863f-97b8-4d80-be4d-fadeef4e462f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.304758 Aug 30 04:31:36.295719 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 363/708] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:35 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:36.301073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.302491 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.303647 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ccfca8e4-e06c-4a85-b4bd-089bc53e4fd6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.305691 Aug 30 04:31:36.304492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 346/709] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:35 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:36.345575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:36.346188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.352036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.352522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.352961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.353671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.354119 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.354540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.554759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.563146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc266038-8d12-40f2-b4d3-b05a217c8fb8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.221313 Aug 30 04:31:36.563810 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 364/710] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:36 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:37.317138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.317669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.324207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.324689 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.325153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.325842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.326297 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.326543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.326937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.327157 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.334038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.334524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.334949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.335640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.336087 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.336515 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.344876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:37.596488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.606304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5e38922e-e4ab-49f2-9eaf-697fc7a82284 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.293198 Aug 30 04:31:37.615948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.620041 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 347/711] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:37.625054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.625674 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.626254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.627703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.628919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0055ed30-d4b6-4744-8c4f-a12e51dea2e6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1809 microversion: 2.20 time: 0.306226 Aug 30 04:31:37.629688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 365/712] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:37.631563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.632236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.632707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.633427 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.634080 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.634694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.775154 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.785089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6dc87d65-ae4e-4a30-bf15-b50a7136f394 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.163548 Aug 30 04:31:37.785761 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 348/713] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:38.627610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.628170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.634952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.635436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.635871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.636558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.637007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.637454 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.652745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.653387 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.659876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.660866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.661330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.662021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.662476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.662899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.832761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.840010 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.840573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0d54c625-24fa-41c3-9b83-826001028433 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.216914 Aug 30 04:31:38.841153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 366/714] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:38.845578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.846174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.850161 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.851670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.852389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.852862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4d3c4d78-f15d-42d6-a229-b7a319cedeee tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1796 microversion: 2.20 time: 0.204072 Aug 30 04:31:38.852989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.853324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.854002 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.854437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.854861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.857407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 349/715] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1796 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:38.986472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.995375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-58b84b39-c8a5-42e6-84f8-b903ef3f3826 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.153296 Aug 30 04:31:38.995933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 367/716] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:39.861988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:39.862596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:39.869992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.870507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.870945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.871636 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.872091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.872514 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.999224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.007100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e3eaf16f-099b-4ce7-9e49-15491e68438a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.148945 Aug 30 04:31:40.007662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 350/717] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:39 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:40.015447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:40.016196 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:40.022570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.023057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.023496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.024185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.024639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.025087 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.152781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.161462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-295e170e-b8c2-409b-8173-d3122159ebac tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.149760 Aug 30 04:31:40.162027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 368/718] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:40 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:41.027780 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:41.028389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:41.034863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.035830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.036259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.036934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.037471 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.037913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.168584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:41.176166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ed345bc3-a14b-4731-a263-ccfec937241b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.152356 Aug 30 04:31:41.176723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 351/719] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:41 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:41.182320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:41.183021 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:41.189368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.189845 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.190278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.190951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.191431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.191876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.316197 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:41.324173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4f5a0062-58c4-4325-ba3b-5c2017fcd90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.145679 Aug 30 04:31:41.324737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 369/720] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:41 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:42.197990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:42.198600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:42.205001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.205509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.205941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.206621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.207070 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.207490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.338838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.345951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:42.346523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-956e3da4-7e4b-4997-9d7f-3dcbd191e718 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1676 microversion: 2.1 time: 0.152341 Aug 30 04:31:42.346671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:42.347301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 352/721] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:42 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:42.353886 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.354375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.354814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.355550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.356008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.356581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.485951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.495154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-97a39151-bfa0-438d-822f-01e4d5a3a0a2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.152996 Aug 30 04:31:42.495734 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 370/722] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:42 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:43.368516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.369168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.375583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.376064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.376498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.377219 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.377672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.378092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.515940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.516682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.523302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.524395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.524843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.525555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.526000 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.526415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.717574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.721825 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.726247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6a2a61a1-c20b-4abc-b9c0-e4a22a0a98bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.214225 Aug 30 04:31:43.726823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 371/723] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:43.730263 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52a69ab6-64e2-4e0f-be96-2350a079c1b6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1653 microversion: 2.1 time: 0.365656 Aug 30 04:31:43.730911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 353/724] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1653 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:43.751030 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-faa00cb1-5878-45a0-8c50-4ffd57fbf53a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:43.756813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa00cb1-5878-45a0-8c50-4ffd57fbf53a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.757329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa00cb1-5878-45a0-8c50-4ffd57fbf53a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.757760 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa00cb1-5878-45a0-8c50-4ffd57fbf53a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.779043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-faa00cb1-5878-45a0-8c50-4ffd57fbf53a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Going to try to start instance {{(pid=120716) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:31:43.819236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-faa00cb1-5878-45a0-8c50-4ffd57fbf53a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action" status: 202 len: 0 microversion: 2.1 time: 0.071779 Aug 30 04:31:43.822793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 372/725] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:43 2022] POST /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:31:43.827854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.828498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.835162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.835645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.836080 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.836770 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.837256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.837678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.975913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.983785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1c22a571-d733-4b0a-b6f3-10a163a3edef tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1662 microversion: 2.1 time: 0.159745 Aug 30 04:31:43.984340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 354/726] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:44.748828 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:44.749586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:44.755684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.756175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.756610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.757326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.757785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.758212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.889320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:44.891590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:44.899501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-59adadb6-6cf1-46a0-8150-e25010a581dd tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.155389 Aug 30 04:31:44.900066 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 373/727] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:44 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:45.005695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:45.006307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:45.012710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.013231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.013667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.014351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.014802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.015225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.141302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:45.149383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-592540a6-9329-4dce-bf5f-07c5ba39f6a2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1662 microversion: 2.1 time: 0.147537 Aug 30 04:31:45.149936 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 355/728] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:45 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:45.921098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:45.921814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:45.929838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.930418 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.930874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.931568 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.932017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.932431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.072156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.080956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-11d5d2ea-5935-4aaf-870a-563ff556b4d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.163686 Aug 30 04:31:46.081562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 374/729] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:45 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:46.171667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.172312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.180498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.180997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.181474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.182164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.182620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.183039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.312885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.321177 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eb920122-e007-4eac-be9a-9c5205ec2526 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1666 microversion: 2.1 time: 0.153640 Aug 30 04:31:46.321733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 356/730] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:47.102463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:47.103086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:47.109766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.110260 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.110732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.111433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.112285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.112285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.240478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.248668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-35068682-7b9e-46ac-8f20-185bd0384728 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.150083 Aug 30 04:31:47.249280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 375/731] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:47 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:48.270619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:48.271208 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:48.277729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.278242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.278679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.279399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.279853 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.280275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.632842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.641132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-49636fc1-68bc-4fbd-b639-3ce27875b447 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.375028 Aug 30 04:31:48.641697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 357/732] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:48 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:49.662663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:49.663271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:49.669775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.670256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.670689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.671374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.671820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.672241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.799308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.807383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7c4c199c-6bf1-4da0-8b65-1a17be14f4fa tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.149243 Aug 30 04:31:49.807952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 376/733] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:49 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:50.828840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:50.829462 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:50.836296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.836767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.837228 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.837904 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.838348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.838764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.965242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:50.973858 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6ee40bf9-4602-479e-a1ab-b62ab8ffde9e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.148848 Aug 30 04:31:50.974399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 358/734] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:50 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:51.995307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:51.995969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:52.002436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.002914 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.003347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.004027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.004476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.004895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.130464 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.138744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cf99dbf5-8da1-483b-a0a3-bff67e5ac78b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.147301 Aug 30 04:31:52.139323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 377/735] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:51 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:53.160202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:53.160816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:53.167015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.167494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.168005 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.168605 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.169077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.169499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.298101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:53.306759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-11299869-d2c2-4c1a-a827-abaa8a7e830c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.150726 Aug 30 04:31:53.307314 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 359/736] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:53 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:54.327729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:54.328354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:54.335475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.335959 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.336394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.337115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.337573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.337997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.465729 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.474031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-83f00cf5-8287-4a36-9444-e1106936cdf6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.150327 Aug 30 04:31:54.474606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 378/737] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:54 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:55.495374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:55.495986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:55.498457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=52 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:55.503822 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.504315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.504751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.505476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.505929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.506353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.634182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.642315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-23edc1be-4ac0-4f9a-8fa0-5c7abb5c2683 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.150902 Aug 30 04:31:55.642872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 360/738] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:55 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:56.664215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.664860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:56.671439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.671918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.672351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.673057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.673517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.673934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.801563 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:56.809963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-392de9ae-6452-42ce-88ea-1c539b947ead tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.149541 Aug 30 04:31:56.810466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 379/739] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:56 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:57.830980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:57.831587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:57.838583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.839064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.839495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.840174 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.840621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.841048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.976029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:57.984199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c3d2f97c-141a-4820-b5ae-92d08d27de00 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.157166 Aug 30 04:31:57.984758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 361/740] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:57 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:59.004678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:59.005314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:59.011763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.012250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.012682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.013411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.013865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.014282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.143656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:59.152219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-517c21ec-b1ef-40b0-bb74-fefb72dc2a5e tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.151407 Aug 30 04:31:59.152786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 380/741] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:58 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:00.174394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.175100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.181997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.182499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.182937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.183608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.184056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.184476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.337549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.345635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98d9d683-80ad-4995-a62a-ea6c6dceba0b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.175119 Aug 30 04:32:00.346208 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 362/742] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:00 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:01.369063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:01.369619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:01.376078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.376559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.376988 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.377690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.378136 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.378552 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.504820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.513944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-74b64846-69b9-49fb-aceb-b2af492ecb8f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1736 microversion: 2.1 time: 0.149507 Aug 30 04:32:01.514571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 381/743] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:01 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:02.534941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.535549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.542055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.542540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.542971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.543653 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.544132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.544554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.669804 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:02.677931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fd5a91ec-34b4-4d47-8bc2-ba746d2d66bc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1716 microversion: 2.1 time: 0.146962 Aug 30 04:32:02.678517 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 363/744] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:02.784421 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.785065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.791464 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.791945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.792376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.793084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.793542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.793963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.872607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b while it is in vm_state rescued Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Request method failure captured: Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments/af8f1bcc-c0d4-4583-b38a-acf8f47cf62f HTTP/1.1 Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFtkdK4PHrjmXsqakn6snyPe3OEZXbSJoaTrGZuOhInCE8AFbRFkPJrS-6B0yrHIS-v637tc77DslZ4uuDNpjfoxsqf8mGVQroVdXuSyfS4tuxgbq5tV3eNjAp1IwCezOre8Yvje9s0Amlk66K2u-OKwwRchElJ2-EyY91fV7UdQAM Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:32:02.874223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_edc09fe630034be4b292562e2de6e3f9"}]}] Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: cbf574ed57d446bc8fabe7813e64e92c Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:32:02.875787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Cannot 'detach_volume' instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b while it is in vm_state rescued Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'server_id': '6d1ca12d-df37-4d58-b819-0e4c7df8fc9b', 'id': 'af8f1bcc-c0d4-4583-b38a-acf8f47cf62f'} Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:02.876474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b while it is in vm_state rescued Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b while it is in vm_state rescued Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:02.878126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Returning 409 to user: Cannot 'detach_volume' instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b while it is in vm_state rescued {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:02.879320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c651461e-4915-4f82-9485-d984245d6d41 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments/af8f1bcc-c0d4-4583-b38a-acf8f47cf62f" status: 409 len: 152 microversion: 2.1 time: 0.095300 Aug 30 04:32:02.879320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 382/745] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:02 2022] DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments/af8f1bcc-c0d4-4583-b38a-acf8f47cf62f => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:32:02.885327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:02.885860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.891838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.892316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.892749 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.893454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.893903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.894321 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.897985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:02.959575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7f831fe6-4d26-489b-abc9-54f2eb93118c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "POST /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/action" status: 202 len: 0 microversion: 2.1 time: 0.077998 Aug 30 04:32:02.962160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 364/746] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:02 2022] POST /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:02.968351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.968967 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.975708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.976238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.976677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.977410 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.977978 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.978424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.108831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.117977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d556e2be-a3f8-486e-889e-d0e264cdb90b tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1724 microversion: 2.1 time: 0.153393 Aug 30 04:32:03.118676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 383/747] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:04.140871 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:04.141595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:04.148419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.148898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.149365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.150050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.150498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.150920 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.277180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:04.285468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-09090264-bcad-40e5-a7f3-31920c7990bb tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1724 microversion: 2.1 time: 0.149283 Aug 30 04:32:04.286028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 365/748] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:04 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:05.135663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-626211547"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:05.136213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:05.138537 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=48 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:05.144152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.144638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.145099 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.145792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.146246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.146669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.272647 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.network.security_group_api [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Removing security group 382602b1-b336-4adf-9199-bc2d0374f6be from port 25b90fd3-3c90-4049-8348-c086d7152285 Aug 30 04:32:05.306994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:05.307643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:05.314040 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.314532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.314969 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.315668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.316133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.316673 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.508620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.517292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-92bf05b1-559d-4c42-ae46-27b3fd845274 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1724 microversion: 2.1 time: 0.214174 Aug 30 04:32:05.517867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 366/749] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:05 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:05.648193 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-83758747-e899-4e83-b4e1-80a50ed064b8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.516400 Aug 30 04:32:05.648812 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 384/750] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:05 2022] POST /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:05.789557 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-2230a797-14e7-40b5-b6e6-94aa5ed5c608 req-4d81df4e-8c18-4df9-8252-c24d6ff1671b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:05.799587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2230a797-14e7-40b5-b6e6-94aa5ed5c608 req-4d81df4e-8c18-4df9-8252-c24d6ff1671b service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.800081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2230a797-14e7-40b5-b6e6-94aa5ed5c608 req-4d81df4e-8c18-4df9-8252-c24d6ff1671b service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.800481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2230a797-14e7-40b5-b6e6-94aa5ed5c608 req-4d81df4e-8c18-4df9-8252-c24d6ff1671b service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.815485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-2230a797-14e7-40b5-b6e6-94aa5ed5c608 req-4d81df4e-8c18-4df9-8252-c24d6ff1671b service nova] Creating event network-changed:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:32:05.821416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-2230a797-14e7-40b5-b6e6-94aa5ed5c608 req-4d81df4e-8c18-4df9-8252-c24d6ff1671b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166237 Aug 30 04:32:05.822480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 367/751] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:06.539823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.540437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.546519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.547012 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.547444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.548136 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.548585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.549022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.762346 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.768437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.769026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.770039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-771b256e-19c1-4009-8b2e-90bcf61414a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1724 microversion: 2.1 time: 0.235219 Aug 30 04:32:06.772759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 385/752] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:06.776128 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.776892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.777479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.778526 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.779253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.779762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.866370 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lazy-loading 'services' on Instance uuid f6237f90-e53d-407a-b307-d8ce658c6e0e {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:06.941316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-69c61475-371a-41fe-a111-0f0de894e0cf tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments/4ed2af32-e5b5-473e-90ed-2d0dd261b23d" status: 202 len: 0 microversion: 2.1 time: 0.176845 Aug 30 04:32:06.941899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 368/753] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:06 2022] DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments/4ed2af32-e5b5-473e-90ed-2d0dd261b23d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:32:06.950746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.952975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.959008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.959431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.959871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.960567 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.961017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.961474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.991180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-21ba977f-5368-4698-be36-6b94bf3b3be7 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Aug 30 04:32:06.991749 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 386/754] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:07.793228 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.793987 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.800207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.800685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.801179 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.802466 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.802910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.803324 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.875337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-3f71b349-2744-4c89-a9f4-739512201f0b req-7ce099ca-fa3b-4fc0-8b17-d1c22b35dac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:07.886164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3f71b349-2744-4c89-a9f4-739512201f0b req-7ce099ca-fa3b-4fc0-8b17-d1c22b35dac3 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.886644 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3f71b349-2744-4c89-a9f4-739512201f0b req-7ce099ca-fa3b-4fc0-8b17-d1c22b35dac3 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.887166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3f71b349-2744-4c89-a9f4-739512201f0b req-7ce099ca-fa3b-4fc0-8b17-d1c22b35dac3 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.898591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-3f71b349-2744-4c89-a9f4-739512201f0b req-7ce099ca-fa3b-4fc0-8b17-d1c22b35dac3 service nova] Creating event network-changed:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:32:07.903645 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-3f71b349-2744-4c89-a9f4-739512201f0b req-7ce099ca-fa3b-4fc0-8b17-d1c22b35dac3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031999 Aug 30 04:32:07.904505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 387/755] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:07.943743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:07.951866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-df80a1be-194e-4932-9cd7-f4226bae4fa1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1730 microversion: 2.1 time: 0.163322 Aug 30 04:32:07.952413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 369/756] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:07.972425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.973002 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.979841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.980351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.980781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.981489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.981934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.982348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.003434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:08.005899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:08.011805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.012284 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.012713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.013421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.013872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.014295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.044633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a3500062-39a9-40bc-a27b-437e84a73c40 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Aug 30 04:32:08.045218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 370/757] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:08.059949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc419c68-5c9a-4bf5-a937-f84e793eafb2 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091660 Aug 30 04:32:08.060535 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 388/758] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:09.055943 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.058170 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.064467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.064944 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.065455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.066131 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.066573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.066993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.095721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-36c8c308-662f-4687-b882-1be27a5e2bd8 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043759 Aug 30 04:32:09.096270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 371/759] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:09 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:09.107937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.108516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.115023 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.115542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.115982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.116690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.117198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.117627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.193370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] HTTP exception thrown: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e is not attached to volume 4ed2af32-e5b5-473e-90ed-2d0dd261b23d Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Request method failure captured: Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments/4ed2af32-e5b5-473e-90ed-2d0dd261b23d HTTP/1.1 Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZHLKUn3FmZmRvWznBUEhlZagcqPfxyU9-Qk6zL5PYNRo1aHBDPEDnem46_tpBtC_5g_LPUa0uOrzSOIKlA-wrMs9jxjixQQBSWcri0UKUAajJgzCHD7pUM30mKIuTNGtoF3BaY9K0haHOsvmXklyRPsCKu7QOWSe5Qpn5QfoLU-Klo Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 3a706ffd11144f46ba54becd86464f02 Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestMinimumBasicScenario-1920839036 Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:32:09.202175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a706ffd11144f46ba54becd86464f02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a706ffd11144f46ba54becd86464f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a706ffd11144f46ba54becd86464f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a706ffd11144f46ba54becd86464f02"}]}] Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestMinimumBasicScenario-1920839036 Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 3a706ffd11144f46ba54becd86464f02 Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1920839036 Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-TestMinimumBasicScenario-1920839036-project Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 5d732bd750a54d8cb516fd5756d64936 Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestMinimumBasicScenario-1920839036-project Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:32:09.203683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e is not attached to volume 4ed2af32-e5b5-473e-90ed-2d0dd261b23d Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'server_id': 'f6237f90-e53d-407a-b307-d8ce658c6e0e', 'id': '4ed2af32-e5b5-473e-90ed-2d0dd261b23d'} Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4ed2af32-e5b5-473e-90ed-2d0dd261b23d. Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:09.204450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e is not attached to volume 4ed2af32-e5b5-473e-90ed-2d0dd261b23d Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e is not attached to volume 4ed2af32-e5b5-473e-90ed-2d0dd261b23d Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:09.205720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Returning 404 to user: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e is not attached to volume 4ed2af32-e5b5-473e-90ed-2d0dd261b23d {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:09.206716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0b8c86b5-c6d1-43ba-9532-10babddde51b tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments/4ed2af32-e5b5-473e-90ed-2d0dd261b23d" status: 404 len: 154 microversion: 2.1 time: 0.100280 Aug 30 04:32:09.206716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 389/760] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:09 2022] DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e/os-volume_attachments/4ed2af32-e5b5-473e-90ed-2d0dd261b23d => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:09.922707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1ca12d-df37-4d58-b819-0e4c7df8fc9b", "tag": "d21ea63a-d1d4-48e3-8e7e-276477e7b961"}, {"name": "network-changed", "server_uuid": "6d1ca12d-df37-4d58-b819-0e4c7df8fc9b", "tag": "d21ea63a-d1d4-48e3-8e7e-276477e7b961"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:09.932677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.933192 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.933623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.944439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] Creating event network-changed:d21ea63a-d1d4-48e3-8e7e-276477e7b961 for instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b on hv-cinder-85426 Aug 30 04:32:09.944939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] Creating event network-changed:d21ea63a-d1d4-48e3-8e7e-276477e7b961 for instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b on hv-cinder-85426 Aug 30 04:32:09.950056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-bcabcd6c-39ab-4dfd-b88f-cd69b024aa5c req-459bf253-9e1c-4003-be67-c4de8a31c434 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030984 Aug 30 04:32:09.950661 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 372/761] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:10.353128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.353573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.360312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.361071 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.361668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.362548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.363445 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.364083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.390315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:10.425475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:10.482376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4af47abd-bc5d-4eea-a799-e35146c5af39 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 204 len: 0 microversion: 2.1 time: 0.133300 Aug 30 04:32:10.483703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 390/762] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:32:10 2022] DELETE /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:10.493069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.493769 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.500264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.500748 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.501206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.501900 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.502380 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.502829 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.642250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.650698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2174e3de-a3d6-4b9c-b3a5-9b4d03bd3ce4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1554 microversion: 2.1 time: 0.162833 Aug 30 04:32:10.651256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 373/763] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:10 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:11.673534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:11.674239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:11.681328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.681816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.682254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.682944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.683399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.683826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.814396 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:11.822165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1812949c-86df-4ef8-b3e4-516e5518786f tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1554 microversion: 2.1 time: 0.152917 Aug 30 04:32:11.822731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 391/764] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:11 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:12.843436 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:12.844036 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:12.851025 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.851524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.851948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.852624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.853086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.853506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.981800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:12.990383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d090714d-f0f9-41c9-866e-90b85032c1f4 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1554 microversion: 2.1 time: 0.150594 Aug 30 04:32:12.990988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 374/765] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:12 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:13.924027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-15ae48a1-91ed-42a4-adf3-7b50efd2f8af req-1e76305f-1fe5-448d-831a-7f00220faf7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6237f90-e53d-407a-b307-d8ce658c6e0e", "name": "network-vif-deleted", "tag": "25b90fd3-3c90-4049-8348-c086d7152285"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:13.933570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-15ae48a1-91ed-42a4-adf3-7b50efd2f8af req-1e76305f-1fe5-448d-831a-7f00220faf7a service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.934073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-15ae48a1-91ed-42a4-adf3-7b50efd2f8af req-1e76305f-1fe5-448d-831a-7f00220faf7a service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.934483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-15ae48a1-91ed-42a4-adf3-7b50efd2f8af req-1e76305f-1fe5-448d-831a-7f00220faf7a service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.946006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-15ae48a1-91ed-42a4-adf3-7b50efd2f8af req-1e76305f-1fe5-448d-831a-7f00220faf7a service nova] Creating event network-vif-deleted:25b90fd3-3c90-4049-8348-c086d7152285 for instance f6237f90-e53d-407a-b307-d8ce658c6e0e on hv-cinder-85426 Aug 30 04:32:13.950726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-15ae48a1-91ed-42a4-adf3-7b50efd2f8af req-1e76305f-1fe5-448d-831a-7f00220faf7a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092419 Aug 30 04:32:13.951327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 392/766] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:14.011879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.012481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.018993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.019470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.019891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.021508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.022023 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.022438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.052882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.053432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.053856 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.054289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lazy-loading 'fault' on Instance uuid f6237f90-e53d-407a-b307-d8ce658c6e0e {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:14.096221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d732bd750a54d8cb516fd5756d64936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a706ffd11144f46ba54becd86464f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.104820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-29ca5bab-d0cd-4a2d-9f0a-805857a881ce tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 200 len: 1348 microversion: 2.1 time: 0.096837 Aug 30 04:32:14.105444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 375/767] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:15.127553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.128289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] [instance: f6237f90-e53d-407a-b307-d8ce658c6e0e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:15.135428 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.135914 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.136350 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.137054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.137517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.137968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.151304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] HTTP exception thrown: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e could not be found. Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Request method failure captured: Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e HTTP/1.1 Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZHLKUn3FmZmRvWznBUEhlZagcqPfxyU9-Qk6zL5PYNRo1aHBDPEDnem46_tpBtC_5g_LPUa0uOrzSOIKlA-wrMs9jxjixQQBSWcri0UKUAajJgzCHD7pUM30mKIuTNGtoF3BaY9K0haHOsvmXklyRPsCKu7QOWSe5Qpn5QfoLU-Klo Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 3a706ffd11144f46ba54becd86464f02 Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestMinimumBasicScenario-1920839036 Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:32:15.152958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a706ffd11144f46ba54becd86464f02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a706ffd11144f46ba54becd86464f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a706ffd11144f46ba54becd86464f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a706ffd11144f46ba54becd86464f02"}]}] Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestMinimumBasicScenario-1920839036 Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 3a706ffd11144f46ba54becd86464f02 Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1920839036 Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-TestMinimumBasicScenario-1920839036-project Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 5d732bd750a54d8cb516fd5756d64936 Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestMinimumBasicScenario-1920839036-project Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e could not be found. Aug 30 04:32:15.154547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'f6237f90-e53d-407a-b307-d8ce658c6e0e'} Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e could not be found. Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:15.155333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e could not be found. Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e could not be found. Aug 30 04:32:15.156531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:15.157654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Returning 404 to user: Instance f6237f90-e53d-407a-b307-d8ce658c6e0e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:15.157654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f951c651-feb1-4a57-b241-edbde4c3d02c tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e" status: 404 len: 111 microversion: 2.1 time: 0.031553 Aug 30 04:32:15.157654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 393/768] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:15 2022] GET /compute/v2.1/servers/f6237f90-e53d-407a-b307-d8ce658c6e0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:15.163464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a31a3ed1-5112-44e3-8465-36bd6c2945f9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] Calling method '.version_select at 0x7fcda3ed9790>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.187233 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a31a3ed1-5112-44e3-8465-36bd6c2945f9 tempest-TestMinimumBasicScenario-1920839036 tempest-TestMinimumBasicScenario-1920839036-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-523824039" status: 202 len: 0 microversion: 2.1 time: 0.027934 Aug 30 04:32:15.188163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 376/769] 10.222.0.85 () {58 vars in 1269 bytes} [Tue Aug 30 04:32:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-523824039 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:32:30.384486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.385183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.388919 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:30.392925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:30.398737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.399563 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.400101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.401274 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.401828 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.402592 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.442747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eb7a7204-ea5e-48f7-8468-537cde1d8cd9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments/7174293a-ea73-4e6e-8e44-491cdca4c650" status: 200 len: 194 microversion: 2.20 time: 0.062726 Aug 30 04:32:30.444062 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 394/770] 10.222.0.85 () {60 vars in 1454 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments/7174293a-ea73-4e6e-8e44-491cdca4c650 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:32:30.522345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:30.528272 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:30.534432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.535609 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.553114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.554115 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.554845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.555826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.556494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.557150 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.709646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lazy-loading 'services' on Instance uuid 0eaa5682-d37f-4718-af65-77b66b3963b7 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:30.837367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-13949f6a-7d45-4426-849b-36b5f4d46fb2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments/7174293a-ea73-4e6e-8e44-491cdca4c650" status: 202 len: 0 microversion: 2.20 time: 0.317899 Aug 30 04:32:30.838508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 377/771] 10.222.0.85 () {60 vars in 1457 bytes} [Tue Aug 30 04:32:30 2022] DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments/7174293a-ea73-4e6e-8e44-491cdca4c650 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:30.847453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.858751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.870467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.871237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.871911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.872781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.873488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.874073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.934237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5b50e4a6-8f5b-4f68-930a-39d5934d94a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090753 Aug 30 04:32:30.940308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 395/772] 10.222.0.85 () {60 vars in 1343 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:32:31.948092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:31.951275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:31.964740 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.969125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.969825 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.970733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.971424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.974630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.059926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3dd4fd1a-d0ff-4285-9bc5-0e9af00b79c6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116064 Aug 30 04:32:32.061268 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 378/773] 10.222.0.85 () {60 vars in 1343 bytes} [Tue Aug 30 04:32:31 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:32:33.073278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.083885 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.092541 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.093029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.093482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.095136 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.095591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.096275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.147944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-05463ef1-debd-4eca-b398-fb6637575671 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079791 Aug 30 04:32:33.148808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 396/774] 10.222.0.85 () {60 vars in 1343 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:33.239198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.239814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.247447 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.248109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.248549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.249292 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.249747 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.250175 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.277312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:33.374389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-51e04d29-ac33-44f2-98d5-52db44019821 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 204 len: 0 microversion: 2.20 time: 0.138822 Aug 30 04:32:33.377116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 379/775] 10.222.0.85 () {60 vars in 1280 bytes} [Tue Aug 30 04:32:33 2022] DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:32:33.388363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.389101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.397850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.398360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.398855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.399534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.400008 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.400422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.508138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9b656357-a4f5-4a46-81ec-1cd5072d3a16 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Action: 'create', calling method: .version_select at 0x7fcda3f27550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1415959040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVAATSft262XlFa7e1NgRHHLxJOlQXeVacQgnrJoiCBgNcpCv6qmpIzwShOPqzJq7sNu0e65DoM2TOlwEjCtKuvvx/BHNTxXt0j+G0NelyHoWO6dUEfS6spH5Cl/MvBCQ=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:33.524601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-9b656357-a4f5-4a46-81ec-1cd5072d3a16 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Getting quotas for project 96907629895d451697f448cf2c3bc6a1. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:33.528737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-9b656357-a4f5-4a46-81ec-1cd5072d3a16 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Getting quotas for user a71c0e86c4b2456abce0e459705a2919 and project 96907629895d451697f448cf2c3bc6a1. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:33.548408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.555626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9b656357-a4f5-4a46-81ec-1cd5072d3a16 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.258402 Aug 30 04:32:33.558678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.560299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:33.561624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5b59d995-2c7a-44c9-b337-6fc570869ea2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.179984 Aug 30 04:32:33.562344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 380/776] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:33.573444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 397/777] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:32:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:34.585622 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:34.586468 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:34.598219 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:34.598731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:34.599199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:34.600114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:34.600573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:34.601002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:34.743875 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.752199 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.754189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.755355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2054106a-32b2-4187-824e-3f4ef73a7058 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.174397 Aug 30 04:32:34.755901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 381/778] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:34 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:35.779508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:35.780498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.790997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.805540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.806015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.806761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.807230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.807663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.952319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:35.961559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:35.963058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:35.964236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1f84ee67-6a53-4bcf-b2f5-cb13c7642c4d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1724 microversion: 2.20 time: 0.189316 Aug 30 04:32:35.964803 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 398/779] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:35 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:36.989637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:36.991431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:36.998699 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.999307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.999738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.000648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.001139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.001756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.081595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:37.089459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:37.090891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:37.092166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c37ea127-1973-4201-8f8f-936e5c73a7e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1656 microversion: 2.20 time: 0.107412 Aug 30 04:32:37.092842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 382/780] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:36 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:37.315532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-7f2f853d-4040-41ad-9bc4-53b46f3625ca req-a72a67c2-bdb2-451c-aaf2-a31a9253bcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eaa5682-d37f-4718-af65-77b66b3963b7", "name": "network-vif-deleted", "tag": "1bbf1f65-3b92-403e-a0f0-5309613fb5f8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:37.326691 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7f2f853d-4040-41ad-9bc4-53b46f3625ca req-a72a67c2-bdb2-451c-aaf2-a31a9253bcf0 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.327252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7f2f853d-4040-41ad-9bc4-53b46f3625ca req-a72a67c2-bdb2-451c-aaf2-a31a9253bcf0 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.327924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7f2f853d-4040-41ad-9bc4-53b46f3625ca req-a72a67c2-bdb2-451c-aaf2-a31a9253bcf0 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.340829 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-7f2f853d-4040-41ad-9bc4-53b46f3625ca req-a72a67c2-bdb2-451c-aaf2-a31a9253bcf0 service nova] Creating event network-vif-deleted:1bbf1f65-3b92-403e-a0f0-5309613fb5f8 for instance 0eaa5682-d37f-4718-af65-77b66b3963b7 on hv-cinder-85426 Aug 30 04:32:37.346868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-7f2f853d-4040-41ad-9bc4-53b46f3625ca req-a72a67c2-bdb2-451c-aaf2-a31a9253bcf0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Aug 30 04:32:37.348701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 399/781] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:38.116470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:38.121304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:38.129583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.130154 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.130589 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.131288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.131735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.132155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.164508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.164987 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.165471 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.165921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lazy-loading 'fault' on Instance uuid 0eaa5682-d37f-4718-af65-77b66b3963b7 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:38.216587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.225514 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.227301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.228462 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5bccd154-af3c-418b-bf9f-9d2e64d5e130 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 200 len: 1371 microversion: 2.20 time: 0.116642 Aug 30 04:32:38.229014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 383/782] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:38 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:39.254759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:39.255464 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:39.261711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.262190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.262624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.263309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.263952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.264373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.278275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] HTTP exception thrown: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Request method failure captured: Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 HTTP/1.1 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZHSFmZjDyW2w81E82yc71fmHOPAQruo30fKpq0QtYQUCaF7GoKy8niOdVSm5ZnH2icGjKygHSCDgZm0cNF8MPTXs-6dUCtgqV-HOtH1upcOULqfZOs8TJtyPkdGwrLoo-io1UJ9Pe6UmlKLtjFaH2yU8QxOAIbRclUIv_aUqS8TmrE Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:32:39.280026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8afb4049582c4beaa9defa2fe20c8b52"}]}] Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: b05dcf62adc949c79b37c92bb3e09e8e Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:32:39.281557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '0eaa5682-d37f-4718-af65-77b66b3963b7'} Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:39.282290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:32:39.283494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:32:39.284585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Returning 404 to user: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:39.284585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-165661cf-0044-4c28-b1df-eb6975184af6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 404 len: 111 microversion: 2.20 time: 0.032526 Aug 30 04:32:39.284585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 400/783] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:39 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:32:39.291274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-38fa680c-4605-4231-97ff-218a7f80969a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '.version_select at 0x7fcda809d3a0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:39.326360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-38fa680c-4605-4231-97ff-218a7f80969a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190946743" status: 204 len: 0 microversion: 2.20 time: 0.038978 Aug 30 04:32:39.326933 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 384/784] 10.222.0.85 () {60 vars in 1262 bytes} [Tue Aug 30 04:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190946743 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:32:39.979512 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b6464b93-b58f-4bad-9593-c4945ef082de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'create', calling method: .version_select at 0x7fcda3f02310>, body: {"keypair": {"name": "tempest-keypair-1622479320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+ovJ2hrJJEby0VcqFm9pHrjGgJ4pxhS92NaQRlx6MbEz3bXe6Gtro5yZ8hO07j6LmIndZ87qIBGn6Qy/5cvspt5YKmwX+XYm8oPQGaXmaOUi+9vzE7M0MEQDbLWCKFxw=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:39.996114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-b6464b93-b58f-4bad-9593-c4945ef082de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:39.999907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-b6464b93-b58f-4bad-9593-c4945ef082de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for user b05dcf62adc949c79b37c92bb3e09e8e and project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:40.023161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b6464b93-b58f-4bad-9593-c4945ef082de tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047682 Aug 30 04:32:40.023756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 401/785] 10.222.0.85 () {62 vars in 1200 bytes} [Tue Aug 30 04:32:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:32:41.319395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1093405815", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a833cc4-0338-4d6e-b00c-99c3817ea5ba"}], "security_groups": [{"name": "tempest-securitygroup--285182581"}], "key_name": "tempest-keypair-1622479320", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:41.425849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] validate_networks() for [('3a833cc4-0338-4d6e-b00c-99c3817ea5ba', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:41.883939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:41.884384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:41.884844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:41.885278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:41.885677 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:41.894207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.894678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.895097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.895826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.896265 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.896685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.913838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:41.917769 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Getting quotas for user b05dcf62adc949c79b37c92bb3e09e8e and project 8afb4049582c4beaa9defa2fe20c8b52. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:41.929224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:41.931510 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:41.978455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b2559945-a24c-4d18-817e-96aaeb573973 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.664019 Aug 30 04:32:41.979100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 385/786] 10.222.0.85 () {62 vars in 1188 bytes} [Tue Aug 30 04:32:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:32:41.991236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-87570b24-84de-459c-afaa-36ec9026ff78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:41.991847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-87570b24-84de-459c-afaa-36ec9026ff78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:42.044933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-87570b24-84de-459c-afaa-36ec9026ff78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:42.052904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-87570b24-84de-459c-afaa-36ec9026ff78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:42.054376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-87570b24-84de-459c-afaa-36ec9026ff78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:42.055492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-87570b24-84de-459c-afaa-36ec9026ff78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1282 microversion: 2.20 time: 0.069493 Aug 30 04:32:42.056051 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 402/787] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:41 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:43.078657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5cc0fd66-ed39-4e64-8318-a921dcb54056 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:43.079258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5cc0fd66-ed39-4e64-8318-a921dcb54056 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:43.134310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5cc0fd66-ed39-4e64-8318-a921dcb54056 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:43.142421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5cc0fd66-ed39-4e64-8318-a921dcb54056 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:43.144006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5cc0fd66-ed39-4e64-8318-a921dcb54056 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:43.145989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5cc0fd66-ed39-4e64-8318-a921dcb54056 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1282 microversion: 2.20 time: 0.071479 Aug 30 04:32:43.146303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 386/788] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:43 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:44.167831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-337087b0-6080-4fc0-8bd6-dbb4b213ee2a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:44.168440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-337087b0-6080-4fc0-8bd6-dbb4b213ee2a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:44.223938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-337087b0-6080-4fc0-8bd6-dbb4b213ee2a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.232619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-337087b0-6080-4fc0-8bd6-dbb4b213ee2a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.233174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-337087b0-6080-4fc0-8bd6-dbb4b213ee2a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.234122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-337087b0-6080-4fc0-8bd6-dbb4b213ee2a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1282 microversion: 2.20 time: 0.070159 Aug 30 04:32:44.234679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 403/789] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:44 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:45.255618 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fb19e5c9-ac04-4cb9-b6f8-abf7870a0532 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:45.256223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fb19e5c9-ac04-4cb9-b6f8-abf7870a0532 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:45.309689 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb19e5c9-ac04-4cb9-b6f8-abf7870a0532 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.317068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb19e5c9-ac04-4cb9-b6f8-abf7870a0532 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.318554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb19e5c9-ac04-4cb9-b6f8-abf7870a0532 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:45.319648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fb19e5c9-ac04-4cb9-b6f8-abf7870a0532 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1282 microversion: 2.20 time: 0.067978 Aug 30 04:32:45.320196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 387/790] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:45 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:46.342848 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:46.344095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:46.351142 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.351826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.352549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.353485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.354133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.354717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.418471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.427745 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.429207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.430307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-707bf66b-ca9e-4726-8b21-8c805ed831cd tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1286 microversion: 2.20 time: 0.092247 Aug 30 04:32:46.430862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 404/791] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:46 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:47.453571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.454267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.461377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.461857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.462305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.462964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.463423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.463898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.528770 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.537863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.539315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.540423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8b52d78d-a013-47c5-983c-fde65a6b4084 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1342 microversion: 2.20 time: 0.090821 Aug 30 04:32:47.540978 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 388/792] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:48.563933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.565112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.572461 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.572932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.573387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.574073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.574519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.574930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.728835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.738077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.740144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.741353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c7b0570f-2a43-4667-a380-b02c7d46f856 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.181520 Aug 30 04:32:48.741987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 405/793] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:49.024203 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-ebcc174d-9011-4d97-8a1c-d7ee4dae0ce3 req-f2dec9a7-b33d-472e-a87a-3a7fc8ea4cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:49.034926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ebcc174d-9011-4d97-8a1c-d7ee4dae0ce3 req-f2dec9a7-b33d-472e-a87a-3a7fc8ea4cc8 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.035382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ebcc174d-9011-4d97-8a1c-d7ee4dae0ce3 req-f2dec9a7-b33d-472e-a87a-3a7fc8ea4cc8 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.036469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ebcc174d-9011-4d97-8a1c-d7ee4dae0ce3 req-f2dec9a7-b33d-472e-a87a-3a7fc8ea4cc8 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.047932 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-ebcc174d-9011-4d97-8a1c-d7ee4dae0ce3 req-f2dec9a7-b33d-472e-a87a-3a7fc8ea4cc8 service nova] Creating event network-changed:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:32:49.053773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-ebcc174d-9011-4d97-8a1c-d7ee4dae0ce3 req-f2dec9a7-b33d-472e-a87a-3a7fc8ea4cc8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036713 Aug 30 04:32:49.054365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 389/794] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:49.765026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.765616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.772739 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.773260 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.773699 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.774389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.774846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.775272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.868345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.870693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.876746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.877282 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.877716 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.878402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.878871 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.879271 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.907835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.908761 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68aaa0b9-5aa9-43f6-b68d-a99c46179032 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044744 Aug 30 04:32:49.909572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 390/795] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:32:49.916126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.917571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.918676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8d9a30cb-f957-40c4-9059-b18f835f47d6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.157603 Aug 30 04:32:49.919222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 406/796] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:49.969547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.970043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.975931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.976414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.976847 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.977551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.978079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.978502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.003093 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:50.078770 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b009fd6b-a5b2-44e4-afa5-3d3723cf18f7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 204 len: 0 microversion: 2.1 time: 0.112689 Aug 30 04:32:50.079439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 391/797] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:32:49 2022] DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:50.087488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.088090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:50.093946 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.094429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.094864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.095544 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.095995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.096415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.225189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:50.232874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-477dd739-8558-43b4-94d8-dc043415b9e4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1672 microversion: 2.1 time: 0.149196 Aug 30 04:32:50.233478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 407/798] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:50 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:50.941320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.942081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:50.948005 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.948494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.948924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.949637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.950089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.950508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.081704 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.090321 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.091737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.092828 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7de493cb-af3e-4757-92c2-f5b99a154c6c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.155891 Aug 30 04:32:51.093394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 392/799] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:50 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:51.256021 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:51.256639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.263100 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.263590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.264042 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.264713 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.265206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.265635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.393056 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:51.401218 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8f91613d-92c7-4ac6-9712-ce0e3e43d103 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1672 microversion: 2.1 time: 0.149675 Aug 30 04:32:51.401785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 408/800] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:52.116769 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:52.117513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:52.119508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:52.125503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.125965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.126394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.127130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.127571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.128011 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.145416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:52.262700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.272429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.274226 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.275338 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-475545c3-9ca9-49ec-b8f2-09f0defb049b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.163484 Aug 30 04:32:52.275921 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 393/801] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:52 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:52.422814 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:52.423419 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:52.430289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.430956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.431307 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.432206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.432649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.433092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.565206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.572808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a91a41d1-1e55-488c-a4f9-539c2648f927 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1672 microversion: 2.1 time: 0.154284 Aug 30 04:32:52.573397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 409/802] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:52 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:52.917373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1752986119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1415959040", "security_groups": [{"name": "tempest-secgroup-smoke-1546792500"}], "networks": [{"uuid": "6e52047f-70d3-42db-935b-902b02a68f1a"}], "block_device_mapping_v2": [{"uuid": "2a181e8e-09fe-485d-a381-bbfca864f8ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:53.108801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] validate_networks() for [('6e52047f-70d3-42db-935b-902b02a68f1a', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:53.298618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.299224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.307370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.307851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.308331 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.308954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.309431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.310041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.635977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.644710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.646183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.647547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f16074d1-2c28-4aca-9ad5-f7689be95062 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.352890 Aug 30 04:32:53.648103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 410/803] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:32:53.652510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.653453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.659166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.659641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.660064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.661459 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.661924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.662330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.012958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.021981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bfb91d44-dcfe-43cc-8c2c-1a8b8219afde tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1605 microversion: 2.1 time: 0.372864 Aug 30 04:32:54.022632 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 411/804] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1605 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.088375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:54.088857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:54.089285 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:54.089907 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:54.090249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:54.099388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.099862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.100283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.100997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.101502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.101919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.118967 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Getting quotas for project 96907629895d451697f448cf2c3bc6a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:54.122841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Getting quotas for user a71c0e86c4b2456abce0e459705a2919 and project 96907629895d451697f448cf2c3bc6a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:54.179983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:54.182136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a181e8e-09fe-485d-a381-bbfca864f8ac',volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:54.266466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-d95069ca-2726-4579-8c8b-193fce3c60e4 req-0fc9fdf5-afa9-46e2-b22a-7cad9c165adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93d3bc-5adc-40f9-b372-b24ded320831", "name": "network-vif-deleted", "tag": "7064d357-6bbe-4302-95ac-eab03664669a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:54.272896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=12 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:54.283343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-d95069ca-2726-4579-8c8b-193fce3c60e4 req-0fc9fdf5-afa9-46e2-b22a-7cad9c165adb service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.284238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-d95069ca-2726-4579-8c8b-193fce3c60e4 req-0fc9fdf5-afa9-46e2-b22a-7cad9c165adb service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.284983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-d95069ca-2726-4579-8c8b-193fce3c60e4 req-0fc9fdf5-afa9-46e2-b22a-7cad9c165adb service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.299419 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-d95069ca-2726-4579-8c8b-193fce3c60e4 req-0fc9fdf5-afa9-46e2-b22a-7cad9c165adb service nova] Creating event network-vif-deleted:7064d357-6bbe-4302-95ac-eab03664669a for instance 3d93d3bc-5adc-40f9-b372-b24ded320831 on hv-cinder-85426 Aug 30 04:32:54.314579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-d95069ca-2726-4579-8c8b-193fce3c60e4 req-0fc9fdf5-afa9-46e2-b22a-7cad9c165adb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051562 Aug 30 04:32:54.315875 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 412/805] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:54.359098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-771a0fb9-683a-4070-9ef9-db1739bd35c2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.445666 Aug 30 04:32:54.366237 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 394/806] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:54.377976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a15900f8-a690-44c7-abe2-42df45e8e397 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.383975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a15900f8-a690-44c7-abe2-42df45e8e397 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.457241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a15900f8-a690-44c7-abe2-42df45e8e397 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.465660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a15900f8-a690-44c7-abe2-42df45e8e397 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1089 microversion: 2.1 time: 0.095410 Aug 30 04:32:54.467391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 413/807] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1089 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.671036 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.671638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.679934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.680415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.680873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.681770 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.682352 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.682877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.848701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.856910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.858376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.859503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-70489f1e-67e6-44d1-8082-fee82adab5f2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.192478 Aug 30 04:32:54.860057 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 395/808] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:55.043823 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.044443 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.052091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.052820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.053447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.054390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.054892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.055407 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.089061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.089557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.089998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.090448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lazy-loading 'fault' on Instance uuid 3d93d3bc-5adc-40f9-b372-b24ded320831 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:55.139176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.149402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5caee591-ce02-4a39-8380-1972870bd11b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 200 len: 1328 microversion: 2.1 time: 0.109229 Aug 30 04:32:55.150272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 414/809] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:55.486524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.487430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.493725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.494201 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.494623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.495300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.495751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.496160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.562855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.570586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c69f6a4b-ce05-4f61-9a7d-4bf9199daafa tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1187 microversion: 2.1 time: 0.087928 Aug 30 04:32:55.571144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 396/810] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:55.883403 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.883949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.890355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.890846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.891280 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.891975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.892430 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.892852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.020891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.029103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.030542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.031695 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-66b5e3fb-f03d-4bcf-8251-f1a187ac5464 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.152919 Aug 30 04:32:56.032261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 415/811] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:56.172586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.173578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.181262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.182072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.182550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.183431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.183889 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.184318 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.198931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] HTTP exception thrown: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Request method failure captured: Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 HTTP/1.1 Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFuHC-UN2QpdBXd6rSkbAyNGC_udM4d4CKIVhb2OkU1mE5r1eowuMAB_LamK7BHqim-0D9CDHYv8lwFJMBpcB8Zpy3X3PalS6MgyUh2_HMos3IOb-M6O894dzITRHDkSXNVillDR6soQ9wM0PC4NTtNksRzhuh_N1UEr4-2GnltNCk Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:32:56.200621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d7deffddf9934a028bfdb0b1c965c618"}]}] Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8ef7a83a87d44fc0a5647cb60057c036 Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:32:56.202249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '3d93d3bc-5adc-40f9-b372-b24ded320831'} Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:56.203209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:32:56.204621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.206017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Returning 404 to user: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:56.206017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9ba6c56d-11cf-42aa-aca8-324bf04b936c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 404 len: 111 microversion: 2.1 time: 0.033777 Aug 30 04:32:56.206017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 397/812] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:56.211322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1afce3be-8c29-4a10-a47c-d5935d75d546 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '.version_select at 0x7fcda3fa31f0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.232556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1afce3be-8c29-4a10-a47c-d5935d75d546 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654006362" status: 202 len: 0 microversion: 2.1 time: 0.025077 Aug 30 04:32:56.233694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 416/813] 10.222.0.85 () {58 vars in 1221 bytes} [Tue Aug 30 04:32:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654006362 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:56.569178 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-2f382257-d8b9-44a9-bf82-3e5a70d149ed req-fea545d2-cb8a-4009-ac6b-97684941c73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "name": "network-vif-plugged", "status": "completed", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:56.585756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2f382257-d8b9-44a9-bf82-3e5a70d149ed req-fea545d2-cb8a-4009-ac6b-97684941c73e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.587154 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2f382257-d8b9-44a9-bf82-3e5a70d149ed req-fea545d2-cb8a-4009-ac6b-97684941c73e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.587834 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2f382257-d8b9-44a9-bf82-3e5a70d149ed req-fea545d2-cb8a-4009-ac6b-97684941c73e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.591797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.592498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.601322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.602057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.602676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.603540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.603953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-2f382257-d8b9-44a9-bf82-3e5a70d149ed req-fea545d2-cb8a-4009-ac6b-97684941c73e service nova] Creating event network-vif-plugged:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:32:56.604374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.605187 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.610608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-2f382257-d8b9-44a9-bf82-3e5a70d149ed req-fea545d2-cb8a-4009-ac6b-97684941c73e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159098 Aug 30 04:32:56.611293 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 398/814] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:56.706128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.714408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2a9737cb-b754-4345-8f8f-70cf0481d721 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1205 microversion: 2.1 time: 0.126482 Aug 30 04:32:56.715315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 417/815] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1205 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:57.054495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.055496 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.065264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.066054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.066702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.067606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.068207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.069646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.089199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a7750eb3-762b-4499-967b-d61bbf8192c3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: .version_select at 0x7fcda3fca040>, body: {"keypair": {"name": "tempest-keypair-1704145336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL90X3sw1l/MdmIYJ/sS8O2LfVEFSoSJXj79ER3DdBfNMHrweoTslfFChl9+kCR5VlOI8xxvJBMGL3fz620IxRJR35MuXhYXgj/CwjQHabc5NBY2pLzsgqJYpD+6sqgH8g=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:57.107043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-a7750eb3-762b-4499-967b-d61bbf8192c3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for project d7deffddf9934a028bfdb0b1c965c618. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:57.114393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-a7750eb3-762b-4499-967b-d61bbf8192c3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for user 8ef7a83a87d44fc0a5647cb60057c036 and project d7deffddf9934a028bfdb0b1c965c618. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:57.141778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a7750eb3-762b-4499-967b-d61bbf8192c3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056669 Aug 30 04:32:57.142666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 418/816] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:32:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:57.221911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.230617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.232398 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.234460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a717bec9-6f66-40ad-9b8c-92f04cc57ed8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.184527 Aug 30 04:32:57.235316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 399/817] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:57.390655 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.391230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.398624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.399206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.399646 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.400353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.400810 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.401268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.406638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:57.491293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'services' on Instance uuid 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:32:57.573598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f19cf244-4243-41bf-897d-8d98e57533a3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments/af8f1bcc-c0d4-4583-b38a-acf8f47cf62f" status: 202 len: 0 microversion: 2.1 time: 0.187221 Aug 30 04:32:57.574509 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 419/818] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:57 2022] DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments/af8f1bcc-c0d4-4583-b38a-acf8f47cf62f => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:57.583157 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.585105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.588617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:57.592652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.593276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.593803 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.594727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.595254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.595729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.634414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a857829a-be85-4815-a577-c92fd973812f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055460 Aug 30 04:32:57.637286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 400/819] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:57.736717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.737610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.744471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.744952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.745627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.746501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.747113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.747694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.963296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.983720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b4a699de-dd4c-4a2c-9f8f-6792160692ad tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1273 microversion: 2.1 time: 0.248204 Aug 30 04:32:57.985505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 420/820] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:58.174210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-823f6797-62c4-4600-875c-b927a4d2f303 req-e46dc510-5cc7-4867-b6c3-726f6369e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:58.186581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-823f6797-62c4-4600-875c-b927a4d2f303 req-e46dc510-5cc7-4867-b6c3-726f6369e4d2 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.187846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-823f6797-62c4-4600-875c-b927a4d2f303 req-e46dc510-5cc7-4867-b6c3-726f6369e4d2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.188432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-823f6797-62c4-4600-875c-b927a4d2f303 req-e46dc510-5cc7-4867-b6c3-726f6369e4d2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.217232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-823f6797-62c4-4600-875c-b927a4d2f303 req-e46dc510-5cc7-4867-b6c3-726f6369e4d2 service nova] Creating event network-changed:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:32:58.223500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-823f6797-62c4-4600-875c-b927a4d2f303 req-e46dc510-5cc7-4867-b6c3-726f6369e4d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052852 Aug 30 04:32:58.225061 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 401/821] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:58.263108 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.267157 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.274116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.274630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.275067 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.275770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.276277 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.276703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.418758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.426934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.428374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.429511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4f86c63b-8227-42d7-9b0e-6af49c95b17a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1407 microversion: 2.20 time: 0.174119 Aug 30 04:32:58.430065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 421/822] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:58.566806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-511317671", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fc2da6b-035c-428c-8a36-2438f46094fd"}], "security_groups": [{"name": "tempest-securitygroup--331762594"}], "key_name": "tempest-keypair-1704145336", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:58.647507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.649800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.655811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.656293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.656723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.657449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.657898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.658320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.669580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] validate_networks() for [('7fc2da6b-035c-428c-8a36-2438f46094fd', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:58.687676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8369ae97-e559-4184-8d3c-6fe545f13ac8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Aug 30 04:32:58.688252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 422/823] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:59.005624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.006347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.009460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:59.013291 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.013781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.014217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.014975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.015441 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.015867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.106771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:59.107195 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:59.107666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:59.108299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:59.108739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:59.118950 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.119435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.119869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.120885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.121450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.121946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.139477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for project d7deffddf9934a028bfdb0b1c965c618. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:59.143399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Getting quotas for user 8ef7a83a87d44fc0a5647cb60057c036 and project d7deffddf9934a028bfdb0b1c965c618. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:59.154685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:59.157091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:59.170227 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.179078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc5d8cc7-bd01-4c8a-aa7c-3f2020724e19 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.177783 Aug 30 04:32:59.179852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 423/824] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:59.205634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-af819eed-d49e-465a-a2f0-f0a6d68cb67c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.643106 Aug 30 04:32:59.206739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 402/825] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:59.217624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b91e0fd7-08e2-440b-aa45-7b1350d50584 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.218373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b91e0fd7-08e2-440b-aa45-7b1350d50584 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.273182 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b91e0fd7-08e2-440b-aa45-7b1350d50584 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.280532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b91e0fd7-08e2-440b-aa45-7b1350d50584 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1237 microversion: 2.1 time: 0.066634 Aug 30 04:32:59.281131 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 424/826] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:59.452068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.452766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.459009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.459495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.459958 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.460650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.461123 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.461551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.598376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.606432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.607862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.609080 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-179395b3-97ec-45dc-80d6-173ad2060893 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1599 microversion: 2.20 time: 0.161170 Aug 30 04:32:59.609582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 403/827] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:59.631797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.632336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.638809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.639293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.639720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.640411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.640855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.641295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.699918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.702278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.708193 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.708675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.709143 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.709831 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.710278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.710729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.742558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-533bf8bc-5879-4aff-a052-0faab79187ef tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Aug 30 04:32:59.743489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 404/828] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:59.759982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-adf62fa2-77c2-4d62-94b4-821361a23bce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.132092 Aug 30 04:32:59.760588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 425/829] 10.222.0.85 () {60 vars in 1316 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:33:00.201000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.201773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.208580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.209183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.209722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.210654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.211306 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.211799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.303156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.304011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.310696 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.311318 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.312174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.312879 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.313362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.313790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.421506 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.429092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5c817f95-d75d-4d72-a46a-c6bc230ad576 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1289 microversion: 2.1 time: 0.131845 Aug 30 04:33:00.429658 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 426/830] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:00.506496 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.514455 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-685859b2-a345-4556-94f2-83ad3859cb39 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.317335 Aug 30 04:33:00.515115 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 405/831] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.755151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.757519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.763753 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.764244 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.764684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.765415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.765872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.766297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.798633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6222279f-0ec0-48a7-afd9-d74c60224759 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Aug 30 04:33:00.799847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 427/832] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:01.304953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-2c9ee1b2-21a8-4c2b-aacb-921229a5b43c req-8fc8dd62-dd48-4679-8876-33a5ca9393b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:01.315193 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2c9ee1b2-21a8-4c2b-aacb-921229a5b43c req-8fc8dd62-dd48-4679-8876-33a5ca9393b9 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.315752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2c9ee1b2-21a8-4c2b-aacb-921229a5b43c req-8fc8dd62-dd48-4679-8876-33a5ca9393b9 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.316476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2c9ee1b2-21a8-4c2b-aacb-921229a5b43c req-8fc8dd62-dd48-4679-8876-33a5ca9393b9 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.327963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-2c9ee1b2-21a8-4c2b-aacb-921229a5b43c req-8fc8dd62-dd48-4679-8876-33a5ca9393b9 service nova] Creating event network-changed:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:33:01.333737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-2c9ee1b2-21a8-4c2b-aacb-921229a5b43c req-8fc8dd62-dd48-4679-8876-33a5ca9393b9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032611 Aug 30 04:33:01.334404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 406/833] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:01.450169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.450774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.458124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.458608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.459036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.459725 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.460168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.460582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.535976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.537082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.539089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.543722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.544400 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.545017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.545916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.546520 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.547093 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.547840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e61bd262-45af-4226-aab3-efb68fa41f95 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1295 microversion: 2.1 time: 0.101311 Aug 30 04:33:01.560944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 428/834] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:01.713280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.722395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ea368934-e6c3-45fd-ad91-25681c669750 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.191218 Aug 30 04:33:01.723120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 407/835] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:01.812035 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.815007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.830468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.831362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.831866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.833703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.835395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.841545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.876486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a810d945-5ce4-4cdd-8a21-5521433133d5 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068567 Aug 30 04:33:01.883385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 429/836] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:33:01.969390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.969892 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.977840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.981816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.985168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.985946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.990903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.991354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.032950 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:02.150325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-522ecfcc-40e8-4969-9d3d-02dc54343230 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 204 len: 0 microversion: 2.1 time: 0.184394 Aug 30 04:33:02.152000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 408/837] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:01 2022] DELETE /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:02.163244 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.164337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.171267 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.172302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.172971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.173931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.174600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.175291 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.319757 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.328127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c7a8402d-e67f-48ec-89a4-6da7068ee4ce tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1690 microversion: 2.1 time: 0.171362 Aug 30 04:33:02.328758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 430/838] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:02.469382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-9c7d2030-da07-4651-9bc9-8433edab8d99 req-1385995a-a145-4414-b512-fc98d3d5565f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178c1257-1a0d-41e3-8961-0f63f6ccfdc2", "tag": "d6d369c3-94ef-47a2-969c-2fe3d82d9f1b"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:02.483722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9c7d2030-da07-4651-9bc9-8433edab8d99 req-1385995a-a145-4414-b512-fc98d3d5565f service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.484421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9c7d2030-da07-4651-9bc9-8433edab8d99 req-1385995a-a145-4414-b512-fc98d3d5565f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.485198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9c7d2030-da07-4651-9bc9-8433edab8d99 req-1385995a-a145-4414-b512-fc98d3d5565f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.498182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-9c7d2030-da07-4651-9bc9-8433edab8d99 req-1385995a-a145-4414-b512-fc98d3d5565f service nova] Creating event network-changed:d6d369c3-94ef-47a2-969c-2fe3d82d9f1b for instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 on hv-cinder-85426 Aug 30 04:33:02.503361 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-9c7d2030-da07-4651-9bc9-8433edab8d99 req-1385995a-a145-4414-b512-fc98d3d5565f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038439 Aug 30 04:33:02.504211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 409/839] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:02.567857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.568815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.575593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.576078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.576511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.577236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.577688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.578106 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.712339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.719991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d178df81-d817-47b1-bd64-2d22fc0a51bd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.156099 Aug 30 04:33:02.720553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 431/840] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:02.744075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.744768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.750845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.751316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.751737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.752404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.752847 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.753289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.880413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.888084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b774ca23-bf0e-467b-8177-bef8f2995a7f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.148108 Aug 30 04:33:02.888655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 410/841] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.349067 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.349696 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.355718 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.356204 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.356661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.357386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.357838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.358264 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.484435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.492809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0ab15eaf-774f-45ef-a59b-f81fe8763083 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1690 microversion: 2.1 time: 0.147607 Aug 30 04:33:03.493406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 432/842] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.741901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.742519 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.748930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.749444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.749882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.750570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.751024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.751456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.881937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.889478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-61916d17-2c5a-44e8-a494-c5b8f0269959 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.152325 Aug 30 04:33:03.890044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 411/843] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.909007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.909649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.916996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.917532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.917969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.918669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.919121 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.919545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.048385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.056553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dcbc15ea-e85e-410b-b522-628d0b99b5df tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.151381 Aug 30 04:33:04.057133 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 433/844] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.514366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.514971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.521675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.522152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.522578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.523277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.523726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.524142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.654393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.662048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98de1893-14d6-4d8b-8813-866ad8a68433 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1690 microversion: 2.1 time: 0.151652 Aug 30 04:33:04.662607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 412/845] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.909926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.910604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.916608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.917116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.917543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.918221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.918664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.919083 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.044518 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.052738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bf73d687-37f2-472d-8a92-4aa82c3f2e10 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.146682 Aug 30 04:33:05.053366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 434/846] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.076955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.077612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.084187 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.084670 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.085142 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.085835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.086288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.086712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.090746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:05.220125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.227798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a76dffab-a4e2-4405-867d-726000c19da1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.154632 Aug 30 04:33:05.228362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 413/847] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.682963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.683573 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.689524 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.690009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.690442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.691126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.691578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.691998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.817770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.825448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4fb85743-6175-4c72-a6df-2aa4ef827a7c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1690 microversion: 2.1 time: 0.146381 Aug 30 04:33:05.826026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 435/848] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:06.073485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.074099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.080022 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.080606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.080923 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.081633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.082583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.083006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.211470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.219029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8c4ed913-7def-49a7-9486-c8febb554dcd tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.149428 Aug 30 04:33:06.219584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 414/849] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:06.248615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.249254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.251910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:33:06.252107 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Tue Aug 30 04:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e (ip 10.222.0.85) !!! Aug 30 04:33:06.258675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.259154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.259580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.260262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.260705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.261149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.280474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:06.398112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.405579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ea8ff252-b249-437b-be08-1b37407a92b7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.160724 Aug 30 04:33:06.406137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 436/850] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:06.846689 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.847309 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.853277 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.853766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.854198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.854883 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.855334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.855759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.985260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.993797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6736113f-edac-473b-a241-26aa0932718c tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1690 microversion: 2.1 time: 0.151022 Aug 30 04:33:06.994359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 415/851] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:07.240482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.241117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.247276 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.247761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.248194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.248883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.249472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.249771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.376030 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:07.383576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-28c5e7e1-64bf-4616-b01b-d560f344bd99 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.147907 Aug 30 04:33:07.384144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 437/852] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:07.425968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.426575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.432896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.433402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.433826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.434495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.434939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.435350 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.565870 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:07.573450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-30159956-fc47-4ebe-941e-c759980a0428 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.151255 Aug 30 04:33:07.574009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 416/853] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:08.014225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:08.014941 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:08.021224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.021804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.022319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.023271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.023635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.024134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.158613 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.167038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-58d8751e-2161-487d-a37b-2afa77ac4ecc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1690 microversion: 2.1 time: 0.156622 Aug 30 04:33:08.167624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 438/854] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:08 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:08.404439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:08.405137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:08.411613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.412102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.412540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.413303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.413760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.414186 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.544072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.553163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-095d2847-a00c-4553-8b06-68d0f20d7a0f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.152646 Aug 30 04:33:08.553957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 417/855] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:08 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:08.595309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:08.595931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:08.603233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.603730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.604167 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.604876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:08.605354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:08.605783 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:08.748468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:08.756405 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1406414-b9ff-4fb3-8557-2e3d234d9749 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.165060 Aug 30 04:33:08.756992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 439/856] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:08 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:09.187859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.188481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.190406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:09.191697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=22 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:09.197791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.198280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.198717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.199411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.199874 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.200296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.267396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.276106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ff0f2f6e-b34f-458d-af77-9fe2e7cb4574 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1622 microversion: 2.1 time: 0.092147 Aug 30 04:33:09.276949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 418/857] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:09.290479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-f2a9a8c7-a3b5-4df4-b9b6-c5d5cc7e1b2d req-b92db674-3884-4b08-889f-dc5506a4172e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1ca12d-df37-4d58-b819-0e4c7df8fc9b", "name": "network-vif-deleted", "tag": "d21ea63a-d1d4-48e3-8e7e-276477e7b961"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:09.295207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=8 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:09.300972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-f2a9a8c7-a3b5-4df4-b9b6-c5d5cc7e1b2d req-b92db674-3884-4b08-889f-dc5506a4172e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.301466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-f2a9a8c7-a3b5-4df4-b9b6-c5d5cc7e1b2d req-b92db674-3884-4b08-889f-dc5506a4172e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.301892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-f2a9a8c7-a3b5-4df4-b9b6-c5d5cc7e1b2d req-b92db674-3884-4b08-889f-dc5506a4172e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.312762 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-f2a9a8c7-a3b5-4df4-b9b6-c5d5cc7e1b2d req-b92db674-3884-4b08-889f-dc5506a4172e service nova] Creating event network-vif-deleted:d21ea63a-d1d4-48e3-8e7e-276477e7b961 for instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b on hv-cinder-85426 Aug 30 04:33:09.318312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-f2a9a8c7-a3b5-4df4-b9b6-c5d5cc7e1b2d req-b92db674-3884-4b08-889f-dc5506a4172e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 Aug 30 04:33:09.318903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 440/858] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:09.573901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.574519 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.581353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.581837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.582273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.582982 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.583424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.583839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.712148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.719946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c3495a69-8a72-422e-a6c4-0f985b1a16f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.149956 Aug 30 04:33:09.720511 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 419/859] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:09.778434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.779044 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.785693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.786179 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.786637 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.787323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.787968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.788181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.922798 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.931297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f0ce9a18-211b-4be7-9b4f-7892e7af66d2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.157547 Aug 30 04:33:09.931934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 441/860] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:10.297215 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.297743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.304662 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.305185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.305618 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.306319 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.306771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.307194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.385926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:10.393667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3c8e1e89-c98c-4e14-993e-e0534ddceec9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 200 len: 1330 microversion: 2.1 time: 0.100429 Aug 30 04:33:10.397686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 420/861] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:10.741328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.741976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.747868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.748469 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.748940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.749658 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.750113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.750539 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.875313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:10.882987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f0e7caaf-59de-4d2d-923e-748ffba2db5a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.146476 Aug 30 04:33:10.883568 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 442/862] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:10.951645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.952258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.958762 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.959247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.959683 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.960369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.960821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.961267 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.093928 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.102296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a05ef960-755b-46eb-9c0b-f1bb4aad9203 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.154465 Aug 30 04:33:11.102862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 421/863] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:11.415152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.415682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.421543 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.422019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.422446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.423121 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.423569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.423985 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.437202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] HTTP exception thrown: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b could not be found. Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Request method failure captured: Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b HTTP/1.1 Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFtkdK4PHrjmXsqakn6snyPe3OEZXbSJoaTrGZuOhInCE8AFbRFkPJrS-6B0yrHIS-v637tc77DslZ4uuDNpjfoxsqf8mGVQroVdXuSyfS4tuxgbq5tV3eNjAp1IwCezOre8Yvje9s0Amlk66K2u-OKwwRchElJ2-EyY91fV7UdQAM Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:33:11.438785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_edc09fe630034be4b292562e2de6e3f9"}]}] Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: cbf574ed57d446bc8fabe7813e64e92c Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b could not be found. Aug 30 04:33:11.440373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '6d1ca12d-df37-4d58-b819-0e4c7df8fc9b'} Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b could not be found. Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:11.441525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b could not be found. Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b could not be found. Aug 30 04:33:11.443617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:11.445103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Returning 404 to user: Instance 6d1ca12d-df37-4d58-b819-0e4c7df8fc9b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:11.445103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3ee91c35-0afc-4933-8ca4-73cd2be7c9c1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b" status: 404 len: 111 microversion: 2.1 time: 0.028955 Aug 30 04:33:11.445103 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 443/864] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:11 2022] GET /compute/v2.1/servers/6d1ca12d-df37-4d58-b819-0e4c7df8fc9b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:11.449090 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8f362308-49b0-4bd1-8a77-31c54cbbef7f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '.version_select at 0x7fcda8456670>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.467799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8f362308-49b0-4bd1-8a77-31c54cbbef7f tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671196160" status: 202 len: 0 microversion: 2.1 time: 0.022542 Aug 30 04:33:11.468347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 422/865] 10.222.0.85 () {58 vars in 1218 bytes} [Tue Aug 30 04:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671196160 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:11.903684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.904412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.910775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.911254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.911677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.912353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.912797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.913308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.122837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:12.123482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:12.130088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.131138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.131568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.132456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.132898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.133546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.159033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.168839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d89fe810-838f-4028-88d0-90af6d6e36f8 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.268905 Aug 30 04:33:12.169705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 444/866] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:11 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:12.279792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:12.281837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ef9493c7-adce-4bc3-9f72-cc35ace77603 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.163054 Aug 30 04:33:12.282395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 423/867] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:12 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:12.627365 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-8b708e36-22d9-4749-aa87-d0f5c78ee1ec req-55ace6f2-53e9-4a47-b6d6-4cd975b547a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "name": "network-vif-plugged", "status": "completed", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:12.637969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8b708e36-22d9-4749-aa87-d0f5c78ee1ec req-55ace6f2-53e9-4a47-b6d6-4cd975b547a8 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.638442 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8b708e36-22d9-4749-aa87-d0f5c78ee1ec req-55ace6f2-53e9-4a47-b6d6-4cd975b547a8 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.639069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8b708e36-22d9-4749-aa87-d0f5c78ee1ec req-55ace6f2-53e9-4a47-b6d6-4cd975b547a8 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.650550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-8b708e36-22d9-4749-aa87-d0f5c78ee1ec req-55ace6f2-53e9-4a47-b6d6-4cd975b547a8 service nova] Creating event network-vif-plugged:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:33:12.655548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-8b708e36-22d9-4749-aa87-d0f5c78ee1ec req-55ace6f2-53e9-4a47-b6d6-4cd975b547a8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031894 Aug 30 04:33:12.656387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 445/868] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:13.191075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.191697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.198710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.199550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.199989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.207721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.208799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.209266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.307860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.308796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.315236 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.315799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.316289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.317305 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.318378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.318983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.353891 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.366826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eda94439-86b7-4751-b006-ae867e989bcb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.179917 Aug 30 04:33:13.367633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 424/869] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:13.468749 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.476436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f0b9dd26-5bcc-4f6b-b933-3501146b4ad2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1261 microversion: 2.1 time: 0.176736 Aug 30 04:33:13.477009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 446/870] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:14.388331 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.389634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.396819 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.397557 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.398017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.398971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.399439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.400056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.448367 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.449774 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.457720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.458379 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.459485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.460418 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.460996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.461577 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.490138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:14.543985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.555044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d7919f42-c477-4ec9-952d-21a01a3a792f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.170484 Aug 30 04:33:14.556498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 425/871] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:14.563860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.565683 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.576070 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.576897 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.578069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.579221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.580353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.580966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.722710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0eee2d06-73c1-453b-a0e9-763dc864d23d tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 204 len: 0 microversion: 2.1 time: 0.278291 Aug 30 04:33:14.723295 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 447/872] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:14 2022] DELETE /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:14.723947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.728251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-50396867-e56e-4eed-a9e4-d91045484c21 req-548f5192-c82a-48c6-a518-48aceded2212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178c1257-1a0d-41e3-8961-0f63f6ccfdc2", "name": "network-vif-plugged", "status": "completed", "tag": "d6d369c3-94ef-47a2-969c-2fe3d82d9f1b"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:14.732082 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ede4d796-c43e-46f4-9cfd-cc5b5837b028 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1445 microversion: 2.1 time: 0.174129 Aug 30 04:33:14.732653 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 426/873] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:14.738364 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.738364 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.743325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-50396867-e56e-4eed-a9e4-d91045484c21 req-548f5192-c82a-48c6-a518-48aceded2212 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.743800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-50396867-e56e-4eed-a9e4-d91045484c21 req-548f5192-c82a-48c6-a518-48aceded2212 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.744100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.744217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-50396867-e56e-4eed-a9e4-d91045484c21 req-548f5192-c82a-48c6-a518-48aceded2212 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.744585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.745014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.745729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.746183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.746604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.754545 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-50396867-e56e-4eed-a9e4-d91045484c21 req-548f5192-c82a-48c6-a518-48aceded2212 service nova] Creating event network-vif-plugged:d6d369c3-94ef-47a2-969c-2fe3d82d9f1b for instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 on hv-cinder-85426 Aug 30 04:33:14.760157 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-50396867-e56e-4eed-a9e4-d91045484c21 req-548f5192-c82a-48c6-a518-48aceded2212 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Aug 30 04:33:14.760739 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 448/874] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:14.765648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.766352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.772251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.772731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.773190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.773881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.774328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.774748 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.937976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.946415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4a253bc4-4bcf-4e80-b72c-7ed79053a212 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1507 microversion: 2.1 time: 0.212682 Aug 30 04:33:14.946932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.947063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 427/875] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:14.954732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-653b28d3-8d18-467b-a753-6cd473cb24e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1445 microversion: 2.1 time: 0.192890 Aug 30 04:33:14.955287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 449/876] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1445 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.577104 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.577653 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.584663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.585194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.585632 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.586327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.586782 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.587206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.825659 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.833381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a47fce05-2ae5-4047-9468-caed2fbf291c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.260177 Aug 30 04:33:15.834519 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 428/877] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.967508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.968256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.975188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.975755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.976201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.976894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.977375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.977799 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.436728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.447992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-10e2a15a-a485-4bb2-870f-5462453ed6a8 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1507 microversion: 2.1 time: 0.484326 Aug 30 04:33:16.449669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 450/878] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:16.855563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:16.856833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.865545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.866307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.873357 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.874295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.874918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.875516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.912259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-fa3e078b-5391-4c8d-bd53-449b53625bad req-81502f60-bc3d-4eef-83ca-c31d8daaf75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a97c5a-7835-4178-8975-f4ce0f14bcda", "name": "network-vif-deleted", "tag": "2fdbdf3d-c596-40b2-9e74-2020a17a72ed"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:16.924930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa3e078b-5391-4c8d-bd53-449b53625bad req-81502f60-bc3d-4eef-83ca-c31d8daaf75b service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.925456 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa3e078b-5391-4c8d-bd53-449b53625bad req-81502f60-bc3d-4eef-83ca-c31d8daaf75b service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.925893 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa3e078b-5391-4c8d-bd53-449b53625bad req-81502f60-bc3d-4eef-83ca-c31d8daaf75b service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.938436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-fa3e078b-5391-4c8d-bd53-449b53625bad req-81502f60-bc3d-4eef-83ca-c31d8daaf75b service nova] Creating event network-vif-deleted:2fdbdf3d-c596-40b2-9e74-2020a17a72ed for instance b6a97c5a-7835-4178-8975-f4ce0f14bcda on hv-cinder-85426 Aug 30 04:33:16.943651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-fa3e078b-5391-4c8d-bd53-449b53625bad req-81502f60-bc3d-4eef-83ca-c31d8daaf75b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Aug 30 04:33:16.944597 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 451/879] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:17.089346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.102114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0f646b63-60f0-44e2-a57a-3b116470a3a4 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.250513 Aug 30 04:33:17.113382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 429/880] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:16 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:17.114146 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-78891405-e2af-4db8-8737-cdf1270d2631 req-b58d1ae8-96ac-4394-82c1-64b6b9f3178f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:17.120228 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-78891405-e2af-4db8-8737-cdf1270d2631 req-b58d1ae8-96ac-4394-82c1-64b6b9f3178f service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.120790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-78891405-e2af-4db8-8737-cdf1270d2631 req-b58d1ae8-96ac-4394-82c1-64b6b9f3178f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.121435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-78891405-e2af-4db8-8737-cdf1270d2631 req-b58d1ae8-96ac-4394-82c1-64b6b9f3178f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.132876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-78891405-e2af-4db8-8737-cdf1270d2631 req-b58d1ae8-96ac-4394-82c1-64b6b9f3178f service nova] Creating event network-changed:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:33:17.138181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-78891405-e2af-4db8-8737-cdf1270d2631 req-b58d1ae8-96ac-4394-82c1-64b6b9f3178f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039198 Aug 30 04:33:17.139971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 452/881] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:17.472084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:17.472733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:17.479043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.479533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.479960 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.480688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.481242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.481663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.548328 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.551813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:17.556791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-469c2c3b-b275-4255-9eab-124fd5825d69 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1292 microversion: 2.1 time: 0.088746 Aug 30 04:33:17.557603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 430/882] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:17 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:18.127091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.127787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.134240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.134722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.135153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.135832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.136278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.136693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.267012 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:18.274561 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52cbeae2-8954-434f-8eb0-7ca7e42f7c6c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1362 microversion: 2.1 time: 0.152488 Aug 30 04:33:18.275119 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 453/883] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:18.578054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.578685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.585581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.586066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.586500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.587188 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.587642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.588072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.618632 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.619108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.619539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.619977 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'fault' on Instance uuid b6a97c5a-7835-4178-8975-f4ce0f14bcda {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:18.663173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:18.670984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-123d1847-e90f-4d9c-86f5-e1c8724333e6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1311 microversion: 2.1 time: 0.097114 Aug 30 04:33:18.671553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 431/884] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:19.295313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:19.295929 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.303330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.303766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.304200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.304894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.305381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.305808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.431574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.439272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5045c95d-8ff5-415a-9a0c-9c3dee2699f2 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1548 microversion: 2.1 time: 0.147880 Aug 30 04:33:19.439830 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 454/885] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:19 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:19.459885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:19.460385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.466431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.466918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.467353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.468039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.468493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.468917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.546591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac198ae2-84eb-4ccc-a266-5e13b3f40640 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090483 Aug 30 04:33:19.554474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 432/886] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:33:19 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:19.691679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:19.692522 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.698462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.698952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.699394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.700091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.700547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.700973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.720238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:19.735918 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.736407 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.737129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.737574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'fault' on Instance uuid b6a97c5a-7835-4178-8975-f4ce0f14bcda {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:19.782586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.790913 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e94597f2-ac88-4b59-86bd-10f76eea95b1 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 200 len: 1311 microversion: 2.1 time: 0.103117 Aug 30 04:33:19.791485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 455/887] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:19 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:20.504119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-f0c985ff-29c4-41bb-91a0-ea80d2c493ea req-79dcc7b5-5583-4730-b829-8f9d798d6b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178c1257-1a0d-41e3-8961-0f63f6ccfdc2", "tag": "d6d369c3-94ef-47a2-969c-2fe3d82d9f1b"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:20.514476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f0c985ff-29c4-41bb-91a0-ea80d2c493ea req-79dcc7b5-5583-4730-b829-8f9d798d6b70 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.515049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f0c985ff-29c4-41bb-91a0-ea80d2c493ea req-79dcc7b5-5583-4730-b829-8f9d798d6b70 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.515547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f0c985ff-29c4-41bb-91a0-ea80d2c493ea req-79dcc7b5-5583-4730-b829-8f9d798d6b70 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.528122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-f0c985ff-29c4-41bb-91a0-ea80d2c493ea req-79dcc7b5-5583-4730-b829-8f9d798d6b70 service nova] Creating event network-changed:d6d369c3-94ef-47a2-969c-2fe3d82d9f1b for instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 on hv-cinder-85426 Aug 30 04:33:20.534254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-f0c985ff-29c4-41bb-91a0-ea80d2c493ea req-79dcc7b5-5583-4730-b829-8f9d798d6b70 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034494 Aug 30 04:33:20.534849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 433/888] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:20.811976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.812594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: b6a97c5a-7835-4178-8975-f4ce0f14bcda] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.820091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.820788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.821259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.821964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.822422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.822848 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.837327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] HTTP exception thrown: Instance b6a97c5a-7835-4178-8975-f4ce0f14bcda could not be found. Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Request method failure captured: Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda HTTP/1.1 Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFtkdK4PHrjmXsqakn6snyPe3OEZXbSJoaTrGZuOhInCE8AFbRFkPJrS-6B0yrHIS-v637tc77DslZ4uuDNpjfoxsqf8mGVQroVdXuSyfS4tuxgbq5tV3eNjAp1IwCezOre8Yvje9s0Amlk66K2u-OKwwRchElJ2-EyY91fV7UdQAM Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:33:20.839004 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_edc09fe630034be4b292562e2de6e3f9"}]}] Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: cbf574ed57d446bc8fabe7813e64e92c Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance b6a97c5a-7835-4178-8975-f4ce0f14bcda could not be found. Aug 30 04:33:20.840594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'b6a97c5a-7835-4178-8975-f4ce0f14bcda'} Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a97c5a-7835-4178-8975-f4ce0f14bcda could not be found. Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:20.841656 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a97c5a-7835-4178-8975-f4ce0f14bcda could not be found. Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a97c5a-7835-4178-8975-f4ce0f14bcda could not be found. Aug 30 04:33:20.843058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:20.844612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Returning 404 to user: Instance b6a97c5a-7835-4178-8975-f4ce0f14bcda could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:20.844612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c1327fb3-15e5-4cd2-8bdd-1c69c703f4f0 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda" status: 404 len: 111 microversion: 2.1 time: 0.032571 Aug 30 04:33:20.844612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 456/889] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/b6a97c5a-7835-4178-8975-f4ce0f14bcda => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:20.850787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.851573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.858544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.859110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.859646 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.860439 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.861008 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.861548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.889566 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:20.965869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:20.973520 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b4015372-2848-4c15-8f59-1588ad617fb6 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 204 len: 0 microversion: 2.1 time: 0.127243 Aug 30 04:33:20.974369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 434/890] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:20 2022] DELETE /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:20.982162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.982877 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.995010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.995782 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.996440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.999027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:21.000144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:21.000853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:21.142552 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:21.150626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-627d13b6-1084-47bf-a0ae-95c2d339a6c3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.172272 Aug 30 04:33:21.151562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 457/891] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:22.172556 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:22.173281 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:22.180799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.181301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.181728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.182426 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.182870 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.183280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.315162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:22.323633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-866b0ac0-6b98-4bef-a3a7-c809eb2af9f9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.155442 Aug 30 04:33:22.324196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 435/892] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:22 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:23.344610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:23.345167 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:23.351584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.352084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.352501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.353229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.353682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.354101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.480380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:23.488209 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8b9aa9c4-c4f1-40b1-84f9-d9ff4f1976d3 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.147509 Aug 30 04:33:23.488769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 458/893] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:23 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:24.508991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:24.509634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:24.515724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.516208 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.516640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.517367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.517823 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.518246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.646539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:24.654196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1dc13908-1d52-441f-a60a-b88fbb74e2a9 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1521 microversion: 2.1 time: 0.149256 Aug 30 04:33:24.654757 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 436/894] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:24 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:24.962664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-8c84d7bc-888f-4f8e-b8b6-4df660bde335 req-4bc94ce8-f9e4-4194-bc09-b4aee949cce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f359fb4c-9bdc-4898-81b0-26ea768f4444", "name": "network-vif-deleted", "tag": "05e9029b-f746-406c-93bb-e93c4ab2ecb9"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:24.973540 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8c84d7bc-888f-4f8e-b8b6-4df660bde335 req-4bc94ce8-f9e4-4194-bc09-b4aee949cce5 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.974057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8c84d7bc-888f-4f8e-b8b6-4df660bde335 req-4bc94ce8-f9e4-4194-bc09-b4aee949cce5 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.974478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-8c84d7bc-888f-4f8e-b8b6-4df660bde335 req-4bc94ce8-f9e4-4194-bc09-b4aee949cce5 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.985435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-8c84d7bc-888f-4f8e-b8b6-4df660bde335 req-4bc94ce8-f9e4-4194-bc09-b4aee949cce5 service nova] Creating event network-vif-deleted:05e9029b-f746-406c-93bb-e93c4ab2ecb9 for instance f359fb4c-9bdc-4898-81b0-26ea768f4444 on hv-cinder-85426 Aug 30 04:33:24.990541 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-8c84d7bc-888f-4f8e-b8b6-4df660bde335 req-4bc94ce8-f9e4-4194-bc09-b4aee949cce5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 Aug 30 04:33:24.991227 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 459/895] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:25.676051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:25.676702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:25.683492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.683978 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.684411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.685138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.685595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.686021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.716668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.717287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.717725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.718164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lazy-loading 'fault' on Instance uuid f359fb4c-9bdc-4898-81b0-26ea768f4444 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:25.764663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf574ed57d446bc8fabe7813e64e92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc09fe630034be4b292562e2de6e3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:25.773002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a8869f5a-b7d5-4668-8b06-a08e94f763dc tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 200 len: 1311 microversion: 2.1 time: 0.101068 Aug 30 04:33:25.782018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 437/896] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:25 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:26.795578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:26.796194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] [instance: f359fb4c-9bdc-4898-81b0-26ea768f4444] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:26.802290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:26.803311 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:26.803736 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:26.804412 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:26.804851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:26.805285 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:26.818098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] HTTP exception thrown: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 could not be found. Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Request method failure captured: Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 HTTP/1.1 Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFtkdK4PHrjmXsqakn6snyPe3OEZXbSJoaTrGZuOhInCE8AFbRFkPJrS-6B0yrHIS-v637tc77DslZ4uuDNpjfoxsqf8mGVQroVdXuSyfS4tuxgbq5tV3eNjAp1IwCezOre8Yvje9s0Amlk66K2u-OKwwRchElJ2-EyY91fV7UdQAM Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:33:26.820334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/edc09fe630034be4b292562e2de6e3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_edc09fe630034be4b292562e2de6e3f9"}]}] Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: edc09fe630034be4b292562e2de6e3f9 Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1780702548 Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: cbf574ed57d446bc8fabe7813e64e92c Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1780702548-project Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 could not be found. Aug 30 04:33:26.821866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'f359fb4c-9bdc-4898-81b0-26ea768f4444'} Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 could not be found. Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:26.822766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 could not be found. Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 could not be found. Aug 30 04:33:26.824259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:33:26.825706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] Returning 404 to user: Instance f359fb4c-9bdc-4898-81b0-26ea768f4444 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:26.825706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-de2de2c6-66f8-4b06-9718-eebd59d7a368 tempest-ServerRescueNegativeTestJSON-1780702548 tempest-ServerRescueNegativeTestJSON-1780702548-project] 10.222.0.85 "GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444" status: 404 len: 111 microversion: 2.1 time: 0.030974 Aug 30 04:33:26.825706 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 460/897] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:26 2022] GET /compute/v2.1/servers/f359fb4c-9bdc-4898-81b0-26ea768f4444 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:57.071012 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=8 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:57.071739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:57.242865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:57.243396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:57.249823 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.250304 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.250737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.251420 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.251872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.252295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.276763 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b8aa0317-8c6a-4410-b536-e4d895237967 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/ips" status: 200 len: 152 microversion: 2.20 time: 0.210549 Aug 30 04:33:57.277360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 438/898] 10.222.0.85 () {60 vars in 1289 bytes} [Tue Aug 30 04:33:57 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/ips => generated 152 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:33:59.131960 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:59.132499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:59.134700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:59.135351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=22 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:59.142841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.143330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.143769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.144461 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.144915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.145435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.168338 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lazy-loading 'flavor' on Instance uuid d05746cb-13ab-4eb9-961b-09d7254f6ce5 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:59.347079 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5d1f0eba-c84a-46eb-9db6-0da7440c8395 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/action" status: 202 len: 0 microversion: 2.20 time: 0.219023 Aug 30 04:33:59.347841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 461/899] 10.222.0.85 () {62 vars in 1319 bytes} [Tue Aug 30 04:33:59 2022] POST /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:59.356204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:59.356807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:59.363655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.364078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.364502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.365216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.365655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.366206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.494262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:59.503005 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:59.504430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:59.505618 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-552565be-7a0d-444b-a849-fb81a723aea8 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.153791 Aug 30 04:33:59.506171 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 439/900] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:59 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:00.528840 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:00.529560 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:00.536538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:00.537011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:00.537463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.538137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:00.538581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:00.538998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.668018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:00.675950 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:00.677401 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:00.678576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ea1b80b-89cc-4a32-9fe3-db430dfab889 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.154596 Aug 30 04:34:00.679111 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 462/901] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:00 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:01.701552 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:01.702148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:01.708553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.709028 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.709478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:01.710153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.710592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.711003 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:01.839139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:01.847066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:01.848493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:01.849678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fea610e2-d238-405a-a863-b6fe909140fb tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.152579 Aug 30 04:34:01.850231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 440/902] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:01 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:02.871622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:02.872243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:02.878761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:02.879256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:02.879693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:02.880465 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:02.880855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:02.881303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.023696 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:03.032417 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:03.033838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:03.035014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-369f6ff0-6ba0-43e3-b6e2-f0fa2ba2ae78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.167279 Aug 30 04:34:03.035567 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 463/903] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:02 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:04.057534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:04.058637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:04.065072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.065500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.065925 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.066603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.067043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.067456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.193479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:04.201962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:04.203370 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:04.204512 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-19347bf3-b5f7-4972-b739-f11fcadbe89f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.150848 Aug 30 04:34:04.205103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 441/904] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:04 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:05.226851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:05.227461 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:05.234460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:05.234940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:05.235371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.236310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:05.236758 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:05.237215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.364766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:05.373373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:05.374811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:05.375970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-603983e3-5d25-4cee-ba9d-90f2cb0ab19b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.153006 Aug 30 04:34:05.376520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 464/905] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:05 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:06.398504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:06.399049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:06.406064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.406544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.406974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.407657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.408105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.408533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.542720 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:06.551326 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:06.552759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:06.553942 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f0a55475-e87b-490e-af2e-57bc30856f76 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.159472 Aug 30 04:34:06.554505 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 442/906] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:06 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:07.577853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:07.578463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:07.584830 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:07.585353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:07.585792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:07.586485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:07.586939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:07.587362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:07.722781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:07.731348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:07.732778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:07.733965 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a13a7e54-cd1f-445c-824d-73988dfb34af tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.160887 Aug 30 04:34:07.734550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 465/907] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:07 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:08.757332 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:08.757939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:08.764371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:08.764844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:08.765301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:08.765978 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:08.766421 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:08.766836 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:08.897010 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:08.905574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:08.906992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:08.908131 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fbecf0c6-07aa-432f-8448-c17c7bc2d2a3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.154709 Aug 30 04:34:08.908679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 443/908] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:08 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:09.929999 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:09.930548 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:09.937760 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:09.938247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:09.938680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:09.939372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:09.939824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:09.940249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:10.065234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:10.073233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:10.074674 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:10.075835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b58ad80b-a0ea-4488-ae01-f6d13e5d1fc6 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.149843 Aug 30 04:34:10.076387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 466/909] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:09 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:11.098789 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:11.099391 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:11.105826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.106305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.106737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.107416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.107859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.108274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.236546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:11.244453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:11.246511 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:11.247651 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-675abb4f-4297-452d-b3fd-7cceb54b22a4 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.152730 Aug 30 04:34:11.248197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 444/910] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:11 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:12.270245 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:12.270853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:12.277988 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:12.278463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:12.278892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:12.279571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:12.280018 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:12.280427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:12.408650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:12.416538 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:12.417991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:12.419171 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-11b0e785-aec6-41b8-8ec4-054782cde014 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.152867 Aug 30 04:34:12.419722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 467/911] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:12 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:13.442545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:13.443183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:13.450156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:13.450641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:13.451078 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.451764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:13.452214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:13.452633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.579948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:13.587917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:13.589949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:13.591112 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c3d6c9e2-2fb8-4722-854f-5fc102eb2397 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.152545 Aug 30 04:34:13.591663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 445/912] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:13 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:14.614049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:14.614663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:14.621502 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.622017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.622436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:14.623147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.623601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.624150 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:14.758853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:14.767162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:14.768606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:14.769807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aa6db64d-6e4c-4eaa-8ea4-3609fb44e5c9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.160056 Aug 30 04:34:14.770371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 468/913] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:14 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:15.794189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:15.795106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:15.801658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:15.802144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:15.802578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.803270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:15.803723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:15.804147 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.933269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:15.942806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:15.944527 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:15.945858 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c2180fd0-7573-496f-a181-ae8ca13595f3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.156235 Aug 30 04:34:15.946506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 446/914] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:15 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:16.969246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:16.969884 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:16.976251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.976733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.977202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.977891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.978343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.978764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.109272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:17.118009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:17.119428 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:17.121212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-276e0896-6eee-42e2-86e6-6d4414690ee7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.155979 Aug 30 04:34:17.121757 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 469/915] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:16 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:18.145309 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:18.146125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:18.153148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:18.153633 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:18.154074 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:18.154761 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:18.155220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:18.155641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:18.282723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:18.290766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:18.292214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:18.293409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-048508c1-575b-4d88-91c6-1c74cdd12f8a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.152255 Aug 30 04:34:18.293964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 447/916] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:18 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:19.316268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:19.316913 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:19.324460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.324953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.325422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.326128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.326585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.327197 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.496571 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:19.504784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:19.506261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:19.507565 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d08f3ac1-247b-4499-bb48-3fc39ed1b34a tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.195226 Aug 30 04:34:19.508125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 470/917] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:19 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:20.529937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:20.530548 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:20.537365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.537849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.538284 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.538971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.539423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.548253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.687838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:20.695879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:20.697359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:20.698515 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ecb35bd9-0d1b-4ec2-9431-7f0d407c87e1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1745 microversion: 2.20 time: 0.172539 Aug 30 04:34:20.699070 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 448/918] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:20 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:21.720865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.721519 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.723432 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1691275570", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:21.727834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.728320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.728757 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.729471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.729928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.730358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.775516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] validate_networks() for None {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:34:22.020393 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.028430 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.029921 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.031128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ec877978-cdb2-4c83-aa52-2d9c6054e2ac tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1745 microversion: 2.20 time: 0.314138 Aug 30 04:34:22.031690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 471/919] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1745 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:22.092477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:22.092899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:22.093402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:22.093841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:22.094459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:22.103232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.103723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.104160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.104903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.105415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.105851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.124241 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Getting quotas for project 37b888e14f724a60bdb1fef1a4aa7cd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:22.128564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Getting quotas for user cfdc2d9a039a4fa6bf04d2cc41b1db57 and project 37b888e14f724a60bdb1fef1a4aa7cd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:22.139867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:22.142221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:22.187978 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d51df122-ee34-4329-8d9b-0fe85e10deb8 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468278 Aug 30 04:34:22.188628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 449/920] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:34:22.199116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2f8801d9-5a76-4d49-a40a-4777c13135f2 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:22.199801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2f8801d9-5a76-4d49-a40a-4777c13135f2 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:22.257063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2f8801d9-5a76-4d49-a40a-4777c13135f2 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:22.264159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2f8801d9-5a76-4d49-a40a-4777c13135f2 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1215 microversion: 2.1 time: 0.068851 Aug 30 04:34:22.265190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 472/921] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:22 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:23.055315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:23.055874 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:23.063183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.064269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.064708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.065801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.066632 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.067337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.284827 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:23.285500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:23.296693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.297308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.298292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.299397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:23.300131 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:23.301009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.527183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.553067 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4f74681b-81ab-4649-80c5-9730673f7f40 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1267 microversion: 2.1 time: 0.272613 Aug 30 04:34:23.562015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 473/922] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:23 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:23.594631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.603449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.604986 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.606420 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d34b8394-3ff2-4b0e-ae66-c5610599c1aa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.555792 Aug 30 04:34:23.608010 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 450/923] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:23 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:24.578539 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:24.579322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:24.586366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.587213 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.587873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.588806 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.589536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.590178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.630198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:24.632193 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:24.641487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.643394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.644489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.647187 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.647827 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.648944 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.663772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.682508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0ad102ad-f691-4ab2-bf61-f212308255be tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1273 microversion: 2.1 time: 0.109493 Aug 30 04:34:24.686184 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 474/924] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:24 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:24.831127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.841687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.843585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:24.845204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-410c2f36-c8fa-4814-8225-c59fe09ccd88 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.218893 Aug 30 04:34:24.858406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 451/925] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:24 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:24.870510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-424e72ad-3f51-4da5-a1a2-150898d38289 req-91eb68e5-4c9c-4707-9c46-753e05cc919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "name": "network-vif-plugged", "status": "completed", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:24.884257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-424e72ad-3f51-4da5-a1a2-150898d38289 req-91eb68e5-4c9c-4707-9c46-753e05cc919e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.885064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-424e72ad-3f51-4da5-a1a2-150898d38289 req-91eb68e5-4c9c-4707-9c46-753e05cc919e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.885707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-424e72ad-3f51-4da5-a1a2-150898d38289 req-91eb68e5-4c9c-4707-9c46-753e05cc919e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.903932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-424e72ad-3f51-4da5-a1a2-150898d38289 req-91eb68e5-4c9c-4707-9c46-753e05cc919e service nova] Creating event network-vif-plugged:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:34:24.915816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-424e72ad-3f51-4da5-a1a2-150898d38289 req-91eb68e5-4c9c-4707-9c46-753e05cc919e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049086 Aug 30 04:34:24.916902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 475/926] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:25.309371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:25.312204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:25.324251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.328774 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.330553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.333913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.334687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.338137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.399657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-69946c20-2c0d-4b10-a077-05dc29a41a55 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/ips" status: 200 len: 146 microversion: 2.1 time: 0.094383 Aug 30 04:34:25.413089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 452/927] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:34:25 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/ips => generated 146 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:25.708234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:25.719955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:25.736286 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.737211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.737868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.738762 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.739347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.739953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.874604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:25.876196 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:25.886685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.887252 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.887603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:25.888867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:25.889340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:25.889759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.010872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.019970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-06c76eff-362f-4d9c-88e3-861c9e3a2bb9 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.316461 Aug 30 04:34:26.021221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 476/928] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:25 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:26.032874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-37c11175-f4a4-407e-b89c-01708d896029 req-ff2ef218-f525-497f-969d-23d1fad8178c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9cd23e-11d9-4a30-853d-7bec1a76aea7", "tag": "781ccf0d-9bf5-4f25-aab9-b47c6702b6d8"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:26.047555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-37c11175-f4a4-407e-b89c-01708d896029 req-ff2ef218-f525-497f-969d-23d1fad8178c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.048298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-37c11175-f4a4-407e-b89c-01708d896029 req-ff2ef218-f525-497f-969d-23d1fad8178c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.048951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-37c11175-f4a4-407e-b89c-01708d896029 req-ff2ef218-f525-497f-969d-23d1fad8178c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.053898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:26.063743 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-37c11175-f4a4-407e-b89c-01708d896029 req-ff2ef218-f525-497f-969d-23d1fad8178c service nova] Creating event network-changed:781ccf0d-9bf5-4f25-aab9-b47c6702b6d8 for instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 on hv-cinder-85426 Aug 30 04:34:26.069310 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-37c11175-f4a4-407e-b89c-01708d896029 req-ff2ef218-f525-497f-969d-23d1fad8178c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046568 Aug 30 04:34:26.070536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 477/929] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:26.092288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.100649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.102328 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.103619 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-77518551-e940-4f42-9790-9b7f98627956 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.234658 Aug 30 04:34:26.104179 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 453/930] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:25 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:26.896217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "140bd1ca-114f-485a-9ed2-f8daf61cb226"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:26.900510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:26.907515 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.908032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.908471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.909491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.909939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.910359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.041687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:27.043903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:27.051710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.052191 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.052652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.053396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.053841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.054251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.199515 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.202702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=93 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:27.210130 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a7fe7c80-76f6-466f-a986-8fa0c067b083 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.172248 Aug 30 04:34:27.211248 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 454/931] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:27 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:27.216097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:27.216863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:27.218736 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:27.225453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.226319 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.226945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.227816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.228438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.228861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.373479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.382339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.383947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:27.385323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-77aa0b70-40d0-4ff6-8eb1-10bc41319183 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.172875 Aug 30 04:34:27.386097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 455/932] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:27 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:28.100441 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1a9c8795-9867-43ad-b9e5-23971d8fe44a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209274 Aug 30 04:34:28.101229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 478/933] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:34:26 2022] POST /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments => generated 194 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:28.231066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:28.232214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:28.238948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.239437 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.239885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.240585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.241060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.241486 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.413284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:28.415948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:28.426323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.427008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.427629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.428483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:28.429168 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:28.429873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.463132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.474406 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3ac1165b-acf3-45b0-b42c-66b01409461f tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.247195 Aug 30 04:34:28.475990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 456/934] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:28 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:28.584683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.595451 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.596112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.597263 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1b3821d5-254e-4cb3-a89f-ecee7a68ba9c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.191312 Aug 30 04:34:28.597873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 479/935] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:28 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:29.496127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:29.496815 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:29.503991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.504608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.505065 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.505754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.506403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.507121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.621502 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:29.623352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:29.626415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=41 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:29.633046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.633577 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.634013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.634714 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.635337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.635944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.665487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.674946 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e4d8e136-5b6a-4bfb-bfde-aa708cd52fe1 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.182872 Aug 30 04:34:29.688628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 457/936] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:29 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:29.780516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.790689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.792602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.793811 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e3572a81-b687-4c1a-9c5e-262244e29226 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.177094 Aug 30 04:34:29.794903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 480/937] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:29 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:30.696055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:30.697493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:30.703859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.704336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.708926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.709686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.710155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.710614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.818351 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:30.819112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:30.826047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.826908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.827570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.828537 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.829250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.829902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.922116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:30.931215 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-22706f68-9237-4c52-9bde-cd6d353b3094 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.238940 Aug 30 04:34:30.933002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 458/938] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:30 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:31.008380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:31.017721 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:31.021601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:31.023061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c414c079-f2b5-4ca7-8fc5-74406fe486d3 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.208587 Aug 30 04:34:31.023866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 481/939] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:30 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:31.953346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:31.954735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:31.962365 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.963117 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.963764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.964840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.965518 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.966719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.046013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:32.046917 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:32.054153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.054982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.055654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.056756 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.057463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.058761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.113914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:32.136035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:32.152343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:32.161423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6ae4846b-01f2-4910-8919-7a1c2b4daee6 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.212469 Aug 30 04:34:32.161998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 459/940] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:31 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:32.239454 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:32.248239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:32.249714 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:32.250909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-62db1cfc-d443-480c-8336-135a43041b56 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1740 microversion: 2.20 time: 0.208862 Aug 30 04:34:32.251479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 482/941] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:32 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:32.865440 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-85e497d8-ea26-4bbd-bea7-6e89326f8d8d req-a405a3a2-54be-4d19-93c0-85f204253907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9cd23e-11d9-4a30-853d-7bec1a76aea7", "name": "network-vif-plugged", "status": "completed", "tag": "781ccf0d-9bf5-4f25-aab9-b47c6702b6d8"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:32.874861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-85e497d8-ea26-4bbd-bea7-6e89326f8d8d req-a405a3a2-54be-4d19-93c0-85f204253907 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.875340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-85e497d8-ea26-4bbd-bea7-6e89326f8d8d req-a405a3a2-54be-4d19-93c0-85f204253907 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.875791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-85e497d8-ea26-4bbd-bea7-6e89326f8d8d req-a405a3a2-54be-4d19-93c0-85f204253907 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.889253 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-85e497d8-ea26-4bbd-bea7-6e89326f8d8d req-a405a3a2-54be-4d19-93c0-85f204253907 service nova] Creating event network-vif-plugged:781ccf0d-9bf5-4f25-aab9-b47c6702b6d8 for instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 on hv-cinder-85426 Aug 30 04:34:32.893984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-85e497d8-ea26-4bbd-bea7-6e89326f8d8d req-a405a3a2-54be-4d19-93c0-85f204253907 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 Aug 30 04:34:32.894894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 460/942] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:33.182746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.183436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.185432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:33.191118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.191787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.192292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.193132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.193718 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.194267 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.275185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.275889 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.283368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.283850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.284476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.285367 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.285971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.286586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.398633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:33.407158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1e9ed17a-9c47-4fcc-8835-8be4d830da86 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.228722 Aug 30 04:34:33.407746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 483/943] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:33.447323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:33.456283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:33.457735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:33.458894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-796632cf-c2f9-4953-9bd3-15076348cc4e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1722 microversion: 2.20 time: 0.188627 Aug 30 04:34:33.459445 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 461/944] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:34.428097 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:34.428640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.435115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.435594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.436024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.436703 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.437197 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.437623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.483247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:34.483863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.490999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.491510 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.491922 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.492643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.493232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.493668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.624487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.632048 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4847fb17-6e2c-4aa3-8302-5cdab46457ad tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1315 microversion: 2.1 time: 0.207958 Aug 30 04:34:34.632622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 484/945] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:34 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:34.652669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.661395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.662809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.663956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2c4997f1-944d-42ca-b264-9854f799e680 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1722 microversion: 2.20 time: 0.185454 Aug 30 04:34:34.664500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 462/946] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:34 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:35.651631 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.652237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.658630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.659128 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.659535 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.660208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.660648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.661075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.687756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.688372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.694952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.695438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.695869 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.696562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.697012 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.697462 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.848640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.856255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9b66c106-d437-41f7-ab92-62cd0d4c354e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1464 microversion: 2.1 time: 0.208425 Aug 30 04:34:35.857505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 485/947] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:35 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:35.870236 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.878635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.879961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.881172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d5a88eed-0c17-443a-8c20-35a1aa2f4928 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1722 microversion: 2.20 time: 0.197950 Aug 30 04:34:35.881724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 463/948] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:35 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:35.900670 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.901195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.907539 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.908019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.908485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.909234 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.909685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.910144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.934857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:36.007684 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d426362a-d317-41ee-bcdb-8282fdf9f2da tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 204 len: 0 microversion: 2.1 time: 0.110748 Aug 30 04:34:36.008255 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 486/949] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:35 2022] DELETE /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:36.016497 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.017137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.023087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.023564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.023990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.024666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.025180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.025599 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.157427 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:36.165132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b9babb76-3a14-4f7a-87e0-43178ed693de tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1470 microversion: 2.1 time: 0.152560 Aug 30 04:34:36.165697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 464/950] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:36.850292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-cc957447-b42b-46e9-816b-a002c2f6b297 req-683d1701-2633-41df-a021-af1801509cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "name": "network-vif-unplugged", "status": "completed", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:36.861391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-cc957447-b42b-46e9-816b-a002c2f6b297 req-683d1701-2633-41df-a021-af1801509cad service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.862001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-cc957447-b42b-46e9-816b-a002c2f6b297 req-683d1701-2633-41df-a021-af1801509cad service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.862434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-cc957447-b42b-46e9-816b-a002c2f6b297 req-683d1701-2633-41df-a021-af1801509cad service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.874011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-cc957447-b42b-46e9-816b-a002c2f6b297 req-683d1701-2633-41df-a021-af1801509cad service nova] Creating event network-vif-unplugged:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:34:36.878790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-cc957447-b42b-46e9-816b-a002c2f6b297 req-683d1701-2633-41df-a021-af1801509cad service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032575 Aug 30 04:34:36.879380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 487/951] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:36.904313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.904955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.911698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.912188 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.912625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.913382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.913840 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.914269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.054289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.062345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.063781 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.064975 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d7b67e66-4895-464b-bb9a-45e6a685d593 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1722 microversion: 2.20 time: 0.165212 Aug 30 04:34:37.065593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 465/952] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:37.186174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:37.186878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:37.192954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.193466 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.193899 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.194619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.195071 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.195490 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.327313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.335078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1fba6603-c016-4595-9372-4364cf647b7b tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1470 microversion: 2.1 time: 0.153159 Aug 30 04:34:37.335642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 488/953] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:37 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:38.088342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.088941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.095890 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.096362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.096786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.097502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.097945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.098360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.225905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.234340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.236009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.237194 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3ab54cc9-0011-446b-9f73-26fc025e6d08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1722 microversion: 2.20 time: 0.152700 Aug 30 04:34:38.237742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 466/954] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:38.355891 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.356501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.363759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.364246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.364701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.365396 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.365849 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.366270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.492894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.500598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-78b0e298-428a-42af-9331-49a4fef40f9e tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1470 microversion: 2.1 time: 0.148790 Aug 30 04:34:38.501207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 489/955] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:39.259580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.260224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.266794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.267273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.267708 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.268394 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.268847 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.269303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.399363 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.407494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.408924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.410105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-54942ff8-33b6-427f-b2dc-61fefbfd5621 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1722 microversion: 2.20 time: 0.154515 Aug 30 04:34:39.410661 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 467/956] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:39.522056 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.522671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.528996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.529512 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.529949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.530636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.531085 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.531506 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.668471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.677077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-393456a4-8735-4932-8e45-9e552b89b108 tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1470 microversion: 2.1 time: 0.158865 Aug 30 04:34:39.677617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 490/957] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:39.911106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.913434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.920125 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.920620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.921066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.921769 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.922223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.922650 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.954616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cb61fda2-3424-4e99-b049-80deb68f850d tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Aug 30 04:34:39.955189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 468/958] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:39.966497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.966996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.973971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.974462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.974904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.975772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.976232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.976660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.009189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9361248e-31e7-49f8-8ad9-85f13b0358b5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/140bd1ca-114f-485a-9ed2-f8daf61cb226" status: 200 len: 194 microversion: 2.1 time: 0.047158 Aug 30 04:34:40.009782 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 491/959] 10.222.0.85 () {58 vars in 1413 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/140bd1ca-114f-485a-9ed2-f8daf61cb226 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:40.380226 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-718c231f-80d9-4ee5-b047-4b5ed8730fad req-b9d0e15f-8056-4ebd-8b9e-7e19c29884f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9cd23e-11d9-4a30-853d-7bec1a76aea7", "name": "network-vif-deleted", "tag": "781ccf0d-9bf5-4f25-aab9-b47c6702b6d8"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:40.390741 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-718c231f-80d9-4ee5-b047-4b5ed8730fad req-b9d0e15f-8056-4ebd-8b9e-7e19c29884f4 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.391221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-718c231f-80d9-4ee5-b047-4b5ed8730fad req-b9d0e15f-8056-4ebd-8b9e-7e19c29884f4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.391654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-718c231f-80d9-4ee5-b047-4b5ed8730fad req-b9d0e15f-8056-4ebd-8b9e-7e19c29884f4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.403842 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-718c231f-80d9-4ee5-b047-4b5ed8730fad req-b9d0e15f-8056-4ebd-8b9e-7e19c29884f4 service nova] Creating event network-vif-deleted:781ccf0d-9bf5-4f25-aab9-b47c6702b6d8 for instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 on hv-cinder-85426 Aug 30 04:34:40.408950 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-718c231f-80d9-4ee5-b047-4b5ed8730fad req-b9d0e15f-8056-4ebd-8b9e-7e19c29884f4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032912 Aug 30 04:34:40.409571 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 469/960] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:40.433226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.433841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.439933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.440422 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.440858 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.441604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.442056 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.442478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.446955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:40.589828 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.598483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.599921 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.601122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9d517386-49fd-45f6-9f15-f58db46aeac7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1725 microversion: 2.20 time: 0.171817 Aug 30 04:34:40.601682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 492/961] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:40 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:40.624591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0b6e76c-c8e9-4141-b47e-86450eab9b4a"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:40.627137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.633280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.633760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.634183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.634872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.635316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.635730 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.698579 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.699192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.712672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.713525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.713980 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.714839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.715430 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.716650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.752587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.753124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.753551 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.754184 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lazy-loading 'fault' on Instance uuid 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:40.805608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdc2d9a039a4fa6bf04d2cc41b1db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b888e14f724a60bdb1fef1a4aa7cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.814926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-61e5b409-3d2d-468d-a9b2-25b167fcc34a tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 200 len: 1305 microversion: 2.1 time: 0.120048 Aug 30 04:34:40.818371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 493/962] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:40 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:40.859532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:40.951245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-22a05175-ff0b-41bc-9488-5330314d03f1 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330987 Aug 30 04:34:40.952150 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 470/963] 10.222.0.85 () {62 vars in 1364 bytes} [Tue Aug 30 04:34:40 2022] POST /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:34:41.070983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.071481 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.077415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.077903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.078339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.079027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.079508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.079935 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.327231 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d0afbc02-3882-41d2-8112-05119606bf73 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-volume_attachments/e0b6e76c-c8e9-4141-b47e-86450eab9b4a" status: 202 len: 0 microversion: 2.20 time: 0.260087 Aug 30 04:34:41.327883 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 494/964] 10.222.0.85 () {60 vars in 1457 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-volume_attachments/e0b6e76c-c8e9-4141-b47e-86450eab9b4a => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:41.388397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:41.388997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.390128 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f057a9d9-e1ab-4fb8-bbf7-2cfe8908128d"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:41.392848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.394948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.395447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.395857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.396546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.397024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.397437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.400254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.400741 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.401206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.401903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.403512 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.404208 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.567084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120716) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:34:41.641472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-18cec081-2f46-407f-bc7d-df2b58168232 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "POST /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/action" status: 202 len: 0 microversion: 2.20 time: 0.256629 Aug 30 04:34:41.642207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 495/965] 10.222.0.85 () {62 vars in 1319 bytes} [Tue Aug 30 04:34:41 2022] POST /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:41.650833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.651584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.658793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.659270 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.659701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.660387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.660833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.661277 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.706857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b797bbb4-8df2-426c-9902-86160179daf3 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "POST /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323822 Aug 30 04:34:41.707465 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 471/966] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:34:41 2022] POST /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:41.825523 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:41.834589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:41.837075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:41.837815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5f7ee58a-d996-40c0-b447-4b596c5b62ce tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1673 microversion: 2.20 time: 0.190792 Aug 30 04:34:41.838359 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 496/967] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:41.838484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.839212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] [instance: 8b9cd23e-11d9-4a30-853d-7bec1a76aea7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.846963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.847416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.847737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.848434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.848885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.849337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.870931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] HTTP exception thrown: Instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 could not be found. Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Request method failure captured: Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 HTTP/1.1 Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZNMo3JN44UPcD43iPYmp5Q8YncBy2vGYFjyQdxgtlpQY_xVaLAZ4op-1R3K3A0NXEx36bh5iAcAzdzcLB_Vj1CqLbxmLag39KpG2QkIua5fjAYFvVFy-64rSL0YsbyVdym1ntrfUo3QB_buQeW0my3KX4auc76JV25vATUFPFU2Y_Y Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 37b888e14f724a60bdb1fef1a4aa7cd7 Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-432078505 Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:34:41.874742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/37b888e14f724a60bdb1fef1a4aa7cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/37b888e14f724a60bdb1fef1a4aa7cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/37b888e14f724a60bdb1fef1a4aa7cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_37b888e14f724a60bdb1fef1a4aa7cd7"}]}] Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-432078505 Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 37b888e14f724a60bdb1fef1a4aa7cd7 Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-432078505 Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-432078505-project Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: cfdc2d9a039a4fa6bf04d2cc41b1db57 Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-432078505-project Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 could not be found. Aug 30 04:34:41.876355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '8b9cd23e-11d9-4a30-853d-7bec1a76aea7'} Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 could not be found. Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.877333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 could not be found. Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 could not be found. Aug 30 04:34:41.878784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.880151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] Returning 404 to user: Instance 8b9cd23e-11d9-4a30-853d-7bec1a76aea7 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.880151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98667317-372f-4028-bb41-cee945cf6fde tempest-VolumesNegativeTest-432078505 tempest-VolumesNegativeTest-432078505-project] 10.222.0.85 "GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7" status: 404 len: 111 microversion: 2.1 time: 0.043053 Aug 30 04:34:41.880151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 472/968] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/8b9cd23e-11d9-4a30-853d-7bec1a76aea7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:34:42.861675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:42.862290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:42.868839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.869398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.869836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.870531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.870983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.871405 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.021239 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.030904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.032371 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.033661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a5763fa6-c579-410c-af74-8c37dde53a51 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1675 microversion: 2.20 time: 0.176253 Aug 30 04:34:43.042847 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 497/969] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:42 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:44.056332 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:44.056997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:44.064388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.064865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.065336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.066029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.066479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.067489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.213972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.222939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.224378 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.225599 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7870c12e-6018-4393-b875-b37987146e50 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.173369 Aug 30 04:34:44.226146 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 473/970] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:44 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:45.250080 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.250905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.258098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.258585 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.259203 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.260112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.260602 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.261028 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.414053 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.423011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.424441 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.425650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-caebc1fd-0bad-4b3e-ba96-e4c96ce9177b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.180122 Aug 30 04:34:45.426199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 498/971] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:45 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:46.449189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:46.451671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:46.459337 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.460092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.460828 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.462171 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.462868 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.463501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.645758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.655019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.660835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.663769 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a81e52d4-7f4f-4b16-8d5a-0d3f3edb965f tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.217422 Aug 30 04:34:46.665868 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 474/972] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:46 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:47.692118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.692801 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.700609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.701122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.701556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.702262 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.702711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.703132 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.914735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.927764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.930036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.931646 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b79847fe-286c-42bc-820e-e636133a5c78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.243638 Aug 30 04:34:47.949070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 499/973] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:48.962899 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.964597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.982955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.983816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.984473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.986266 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.986947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.987583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.213754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.224994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.228685 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.231632 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cd5bf7d8-c820-48d1-8b8d-dde6d5dd42e9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.273048 Aug 30 04:34:49.232415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 475/974] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:50.256391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:50.257017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:50.282447 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.284939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.286248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.287951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.288436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.288876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.671189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.688186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.693708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.698073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0fd0774c-d02f-42c1-903f-5b3d78748a53 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.443357 Aug 30 04:34:50.698956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 500/975] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:50 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:51.735290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.737316 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.757168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.758067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.758844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.759807 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.760545 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.774974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.073777 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.083441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.084968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:52.086409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f869d571-5f3c-4659-85b0-58ea7330b051 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.365124 Aug 30 04:34:52.091478 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 476/976] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:53.130075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:53.131865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:53.147141 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.148150 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.148892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.151792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.153116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.153552 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.316278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.324649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.326253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.327425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0bfe2131-5ee1-4ac8-9d9f-66954fe888e5 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.220739 Aug 30 04:34:53.328095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 501/977] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:53 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:54.351841 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:54.353159 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:54.366233 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.367276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.368342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.369348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.370384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.372861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.653866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:54.663411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:54.664862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:54.666095 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0c225f86-e551-4bac-8dd8-26cad8946539 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.318194 Aug 30 04:34:54.683145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 477/978] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:54 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:54.862279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:54.865652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:54.872611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.873199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.873650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.874366 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.874824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.875352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.914707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-545acaf5-4986-419a-b2da-3d88d875d1b7 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058101 Aug 30 04:34:54.915471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 502/979] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:54 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:55.065108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:55.065616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:55.077990 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.079225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.079665 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.080440 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.080843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.081335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.141666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8217aa9d-b1fe-4c10-a210-c2ea5a8ae228 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/140bd1ca-114f-485a-9ed2-f8daf61cb226" status: 200 len: 194 microversion: 2.1 time: 0.080481 Aug 30 04:34:55.149606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 478/980] 10.222.0.85 () {58 vars in 1413 bytes} [Tue Aug 30 04:34:55 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/140bd1ca-114f-485a-9ed2-f8daf61cb226 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:55.153460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:55.153964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:55.161409 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.161910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.162352 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.163085 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.163572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.163907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.297112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lazy-loading 'services' on Instance uuid 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:55.430175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-395de0d9-52ca-4e05-b288-ec10cb689d07 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/140bd1ca-114f-485a-9ed2-f8daf61cb226" status: 202 len: 0 microversion: 2.1 time: 0.280509 Aug 30 04:34:55.434186 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 503/981] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:34:55 2022] DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/140bd1ca-114f-485a-9ed2-f8daf61cb226 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:34:55.694788 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:55.696079 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:55.705664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.706174 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.706766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.711087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.711087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.711087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:56.016310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:56.029629 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:56.031771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:56.033211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cc2e87a5-3f9a-4097-89db-b36efe5756e7 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.342372 Aug 30 04:34:56.034347 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 479/982] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:55 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:57.071916 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.074068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.084463 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.085778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.087339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.090591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.092392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.093631 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.140963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:57.352728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:57.369403 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:57.371933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:57.373936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d223fd74-4071-429a-b76b-ea5f1c876b08 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.311309 Aug 30 04:34:57.374717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 504/983] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:57 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:34:57.678251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.678873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.687059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=50 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:57.688993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.689728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.690433 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.691087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.691635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.692153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.728094 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2b421e2f-f319-418f-9b2d-70698d5c8638 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/f057a9d9-e1ab-4fb8-bbf7-2cfe8908128d" status: 200 len: 194 microversion: 2.1 time: 0.053722 Aug 30 04:34:57.729003 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 480/984] 10.222.0.85 () {58 vars in 1413 bytes} [Tue Aug 30 04:34:57 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/f057a9d9-e1ab-4fb8-bbf7-2cfe8908128d => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:57.741600 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.742455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.749535 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.750337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.751019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.751970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.752653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.753354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.772018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-ac6ed0eb-30e1-4c17-80e5-5afc715b01f7 req-99c9285b-9fdf-4860-ad48-72f0f4ff9bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "name": "network-vif-plugged", "status": "completed", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:57.782168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ac6ed0eb-30e1-4c17-80e5-5afc715b01f7 req-99c9285b-9fdf-4860-ad48-72f0f4ff9bc5 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.782924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ac6ed0eb-30e1-4c17-80e5-5afc715b01f7 req-99c9285b-9fdf-4860-ad48-72f0f4ff9bc5 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.783558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ac6ed0eb-30e1-4c17-80e5-5afc715b01f7 req-99c9285b-9fdf-4860-ad48-72f0f4ff9bc5 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.796652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-ac6ed0eb-30e1-4c17-80e5-5afc715b01f7 req-99c9285b-9fdf-4860-ad48-72f0f4ff9bc5 service nova] Creating event network-vif-plugged:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:34:57.804843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-ac6ed0eb-30e1-4c17-80e5-5afc715b01f7 req-99c9285b-9fdf-4860-ad48-72f0f4ff9bc5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035624 Aug 30 04:34:57.805778 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 481/985] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:57.865507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lazy-loading 'services' on Instance uuid 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:34:58.012802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-64a7aaa1-9443-4544-abf9-0f8b3933ef19 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/f057a9d9-e1ab-4fb8-bbf7-2cfe8908128d" status: 202 len: 0 microversion: 2.1 time: 0.269897 Aug 30 04:34:58.013926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 505/986] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:34:57 2022] DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments/f057a9d9-e1ab-4fb8-bbf7-2cfe8908128d => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:58.408299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:58.411300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:58.418668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.419163 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.419595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.420611 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.421323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.421752 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.565854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:58.576182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:58.577795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:58.579270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8edb5949-bda1-43a9-bd4c-5ac84744f725 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.183919 Aug 30 04:34:58.580056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 482/987] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:58 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:34:58.618718 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-42d058f4-5601-4f2b-88dd-83c8f3d6f19b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Action: 'create', calling method: .version_select at 0x7fcda81c5700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-754690315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDK1yVMyncnBvXzQArL9JyKcdMGmhBAoZEB7fUcuAEEo9juPHpLDvdj9kjxHLU5n8LK7VJjf8NPCJGJIHefck8L/sYOVdi6/jLqyVu2O1/WN0sxx7mvzO/ug8Vj8Z3aUg=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.634991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-42d058f4-5601-4f2b-88dd-83c8f3d6f19b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for project 18e4bf7297124da4b43ccaeda048f772. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:58.639872 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-42d058f4-5601-4f2b-88dd-83c8f3d6f19b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for user 2625939a0b9a43d59452df9ba9982ecb and project 18e4bf7297124da4b43ccaeda048f772. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:58.661735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-42d058f4-5601-4f2b-88dd-83c8f3d6f19b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.259280 Aug 30 04:34:58.662434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 506/988] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:59.610216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:59.611422 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:59.620210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.620715 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.621254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.621964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.622420 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.622991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.843686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:59.859048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:59.861193 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:59.862715 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8fc1dfca-2702-4dc2-9462-a9f0f647a390 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1731 microversion: 2.20 time: 0.263826 Aug 30 04:34:59.863879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 483/989] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:34:59 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:00.366572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.368994 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.372333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:00.382414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.382992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.383471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.384402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.384628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.385107 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.423834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d3db395e-8e2d-4540-97fa-7a78771e697f tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062088 Aug 30 04:35:00.436012 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 507/990] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:00 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:35:00.568694 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.572435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.579121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.579612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.580246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.580945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.581424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.582007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.616039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-69eb3625-0d6f-4b28-be55-4d2754aca514 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051250 Aug 30 04:35:00.617250 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 484/991] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:00 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:35:00.680653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.681185 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.692241 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.692881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.693437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.694141 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.694599 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.695022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.723587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:00.813746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d717966b-8415-4d06-a15a-1db366110206 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 204 len: 0 microversion: 2.1 time: 0.136623 Aug 30 04:35:00.815056 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 508/992] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:00 2022] DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:00.824418 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.825581 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.834160 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.834826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.835469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.836393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.837031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.837669 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.889292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.890460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.898899 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.899636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.906251 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.907161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.907865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.908335 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.050048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.058535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d751caa7-54f4-4238-9798-df61bfb0ba3b tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1673 microversion: 2.1 time: 0.238866 Aug 30 04:35:01.059122 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 485/993] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:00 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1673 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:01.099113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.107389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.108822 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.110372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8d0ea395-9832-4ca6-aa90-73ec244a6f7c tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1718 microversion: 2.20 time: 0.226049 Aug 30 04:35:01.110934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 509/994] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:00 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1718 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:02.080390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:02.080995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:02.087878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.088470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.088908 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.090114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.090797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.091283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.237615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:02.240959 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:02.249419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-422f055f-cbbd-4e66-8d56-4bd69dbf458c tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1673 microversion: 2.1 time: 0.172734 Aug 30 04:35:02.250809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 486/995] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:02 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:03.271971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.272530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.281652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.282257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.282810 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.283639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.284202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.284746 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.430888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:03.440264 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-29ee496e-86ad-4887-9f8e-d0e186c0b812 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1673 microversion: 2.1 time: 0.172190 Aug 30 04:35:03.440861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 510/996] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:03 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:04.401975 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-3f6d2e7f-e46a-4e6f-8556-3332d0c2c3c3 req-09def5e8-59e1-4bfe-a9b5-9e446905ffba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178c1257-1a0d-41e3-8961-0f63f6ccfdc2", "name": "network-vif-deleted", "tag": "d6d369c3-94ef-47a2-969c-2fe3d82d9f1b"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:04.417530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-3f6d2e7f-e46a-4e6f-8556-3332d0c2c3c3 req-09def5e8-59e1-4bfe-a9b5-9e446905ffba service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.418755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-3f6d2e7f-e46a-4e6f-8556-3332d0c2c3c3 req-09def5e8-59e1-4bfe-a9b5-9e446905ffba service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.419189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-3f6d2e7f-e46a-4e6f-8556-3332d0c2c3c3 req-09def5e8-59e1-4bfe-a9b5-9e446905ffba service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.437223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-3f6d2e7f-e46a-4e6f-8556-3332d0c2c3c3 req-09def5e8-59e1-4bfe-a9b5-9e446905ffba service nova] Creating event network-vif-deleted:d6d369c3-94ef-47a2-969c-2fe3d82d9f1b for instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 on hv-cinder-85426 Aug 30 04:35:04.450979 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-3f6d2e7f-e46a-4e6f-8556-3332d0c2c3c3 req-09def5e8-59e1-4bfe-a9b5-9e446905ffba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054614 Aug 30 04:35:04.455409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 487/997] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:04.462029 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:04.462643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:04.469362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.470079 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.470690 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.471605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.472058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.472554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.564948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7a83a87d44fc0a5647cb60057c036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deffddf9934a028bfdb0b1c965c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:04.575937 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8bc703fc-afff-4fa0-af1d-ce56ff22e258 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 200 len: 1322 microversion: 2.1 time: 0.118138 Aug 30 04:35:04.576539 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 511/998] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:04 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 1322 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:05.598607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:05.599373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:05.607354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.607989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.608573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.609707 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.610297 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.610865 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.625015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] HTTP exception thrown: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Request method failure captured: Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 HTTP/1.1 Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFuHC-UN2QpdBXd6rSkbAyNGC_udM4d4CKIVhb2OkU1mE5r1eowuMAB_LamK7BHqim-0D9CDHYv8lwFJMBpcB8Zpy3X3PalS6MgyUh2_HMos3IOb-M6O894dzITRHDkSXNVillDR6soQ9wM0PC4NTtNksRzhuh_N1UEr4-2GnltNCk Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:35:05.626724 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d7deffddf9934a028bfdb0b1c965c618"}]}] Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8ef7a83a87d44fc0a5647cb60057c036 Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:05.628450 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '178c1257-1a0d-41e3-8961-0f63f6ccfdc2'} Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:05.629371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:05.630652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:05.631797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Returning 404 to user: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:05.631797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52424642-4002-4fa9-b125-41bd564d3a0a tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 404 len: 111 microversion: 2.1 time: 0.034271 Aug 30 04:35:05.631797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 488/999] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:05 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:05.637125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-952f8d47-1d33-4027-8ce5-14e2c16a4732 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '.version_select at 0x7fcda8121820>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:05.658137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-952f8d47-1d33-4027-8ce5-14e2c16a4732 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704145336" status: 202 len: 0 microversion: 2.1 time: 0.024803 Aug 30 04:35:05.658963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 512/1000] 10.222.0.85 () {58 vars in 1221 bytes} [Tue Aug 30 04:35:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704145336 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:08.567124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:08.567612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.574433 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.574906 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.575330 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.576000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.576443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.576885 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.590795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] HTTP exception thrown: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Request method failure captured: Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 HTTP/1.1 Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFuHC-UN2QpdBXd6rSkbAyNGC_udM4d4CKIVhb2OkU1mE5r1eowuMAB_LamK7BHqim-0D9CDHYv8lwFJMBpcB8Zpy3X3PalS6MgyUh2_HMos3IOb-M6O894dzITRHDkSXNVillDR6soQ9wM0PC4NTtNksRzhuh_N1UEr4-2GnltNCk Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:35:08.592298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d7deffddf9934a028bfdb0b1c965c618"}]}] Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8ef7a83a87d44fc0a5647cb60057c036 Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.593773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '178c1257-1a0d-41e3-8961-0f63f6ccfdc2'} Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:08.594509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.596149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.597742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Returning 404 to user: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:08.597742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8b6da596-a9e7-487a-9802-fe4717da4ed5 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 404 len: 111 microversion: 2.1 time: 0.030467 Aug 30 04:35:08.597742 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 489/1001] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:08 2022] DELETE /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:08.604385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:08.605238 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 178c1257-1a0d-41e3-8961-0f63f6ccfdc2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.617773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.618561 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.619102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.620091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.620557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.621144 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.638610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] HTTP exception thrown: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Request method failure captured: Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 HTTP/1.1 Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFuHC-UN2QpdBXd6rSkbAyNGC_udM4d4CKIVhb2OkU1mE5r1eowuMAB_LamK7BHqim-0D9CDHYv8lwFJMBpcB8Zpy3X3PalS6MgyUh2_HMos3IOb-M6O894dzITRHDkSXNVillDR6soQ9wM0PC4NTtNksRzhuh_N1UEr4-2GnltNCk Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:08.640643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d7deffddf9934a028bfdb0b1c965c618"}]}] Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8ef7a83a87d44fc0a5647cb60057c036 Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.642256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '178c1257-1a0d-41e3-8961-0f63f6ccfdc2'} Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:08.643160 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. Aug 30 04:35:08.644955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:08.646408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Returning 404 to user: Instance 178c1257-1a0d-41e3-8961-0f63f6ccfdc2 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:08.646408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c3380d5-e0be-4b74-a773-e2a76ca820bb tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2" status: 404 len: 111 microversion: 2.1 time: 0.043085 Aug 30 04:35:08.646408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 513/1002] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:08 2022] GET /compute/v2.1/servers/178c1257-1a0d-41e3-8961-0f63f6ccfdc2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:09.782212 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.782740 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.790088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.790088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.790360 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.791001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.791615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.791874 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.809166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] HTTP exception thrown: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Request method failure captured: Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 HTTP/1.1 Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZFuHC-UN2QpdBXd6rSkbAyNGC_udM4d4CKIVhb2OkU1mE5r1eowuMAB_LamK7BHqim-0D9CDHYv8lwFJMBpcB8Zpy3X3PalS6MgyUh2_HMos3IOb-M6O894dzITRHDkSXNVillDR6soQ9wM0PC4NTtNksRzhuh_N1UEr4-2GnltNCk Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:35:09.810734 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d7deffddf9934a028bfdb0b1c965c618"}]}] Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8ef7a83a87d44fc0a5647cb60057c036 Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.812935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '3d93d3bc-5adc-40f9-b372-b24ded320831'} Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:09.814062 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.816056 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.817559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Returning 404 to user: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:09.817559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4312e4ee-d174-4274-9a00-772877f4f4a1 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 404 len: 111 microversion: 2.1 time: 0.033845 Aug 30 04:35:09.817559 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 490/1003] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:09 2022] DELETE /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:09.828605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.829275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] [instance: 3d93d3bc-5adc-40f9-b372-b24ded320831] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.831476 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:09.844806 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.844806 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.845342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.845939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.846456 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.847205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.863486 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] HTTP exception thrown: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Request method failure captured: Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 HTTP/1.1 Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZFuHC-UN2QpdBXd6rSkbAyNGC_udM4d4CKIVhb2OkU1mE5r1eowuMAB_LamK7BHqim-0D9CDHYv8lwFJMBpcB8Zpy3X3PalS6MgyUh2_HMos3IOb-M6O894dzITRHDkSXNVillDR6soQ9wM0PC4NTtNksRzhuh_N1UEr4-2GnltNCk Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:09.865378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d7deffddf9934a028bfdb0b1c965c618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d7deffddf9934a028bfdb0b1c965c618"}]}] Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: d7deffddf9934a028bfdb0b1c965c618 Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673111845 Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8ef7a83a87d44fc0a5647cb60057c036 Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeTestJSON-1673111845-project Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.868866 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '3d93d3bc-5adc-40f9-b372-b24ded320831'} Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:09.869867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. Aug 30 04:35:09.871248 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:09.872973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] Returning 404 to user: Instance 3d93d3bc-5adc-40f9-b372-b24ded320831 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:09.872973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-59fa3bf8-99a0-4c5c-bcfd-79004dfe32f6 tempest-AttachVolumeTestJSON-1673111845 tempest-AttachVolumeTestJSON-1673111845-project] 10.222.0.85 "GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831" status: 404 len: 111 microversion: 2.1 time: 0.042360 Aug 30 04:35:09.872973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 514/1004] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:09 2022] GET /compute/v2.1/servers/3d93d3bc-5adc-40f9-b372-b24ded320831 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:14.562809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-46636119-d036-4e70-9832-f1419ce3e29f tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Action: 'create', calling method: .version_select at 0x7fcda8230ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-589733639"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:14.862718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-46636119-d036-4e70-9832-f1419ce3e29f tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.425727 Aug 30 04:35:14.863338 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 491/1005] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Aug 30 04:35:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 04:35:14.875435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b32f7c36-f94d-4347-80d6-33be035f9ada tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda8036ca0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:14.938438 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b32f7c36-f94d-4347-80d6-33be035f9ada tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 200 len: 344 microversion: 2.1 time: 0.066711 Aug 30 04:35:14.939125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 515/1006] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:35:14 2022] GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:15.958231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5e146cdf-cf72-4e89-a96e-bd057a4b284d tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda819fc10>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.018563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5e146cdf-cf72-4e89-a96e-bd057a4b284d tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 200 len: 345 microversion: 2.1 time: 0.067842 Aug 30 04:35:16.019794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 492/1007] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:35:15 2022] GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:16.035685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a7b0a374-9f8a-4715-9d34-e8811fa7f1fe tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Action: 'create', calling method: .version_select at 0x7fcda84d2b80>, body: {"snapshot": {"volume_id": "3893395d-24e3-49a7-a501-9df679c1a64b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-280828433"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:16.211193 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a7b0a374-9f8a-4715-9d34-e8811fa7f1fe tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.182664 Aug 30 04:35:16.211784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 516/1008] 10.222.0.85 () {60 vars in 1162 bytes} [Tue Aug 30 04:35:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:16.223002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9dda0138-2956-4460-a036-b1dc4e370a87 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda82d4040>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.257014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9dda0138-2956-4460-a036-b1dc4e370a87 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 286 microversion: 2.1 time: 0.038081 Aug 30 04:35:16.258002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 493/1009] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:16 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:16.273582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6c0e1abc-b25e-4ef4-8e4d-59106922473a tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda8106550>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.320683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6c0e1abc-b25e-4ef4-8e4d-59106922473a tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.053749 Aug 30 04:35:16.321559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 517/1010] 10.222.0.85 () {58 vars in 1140 bytes} [Tue Aug 30 04:35:16 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:16.333647 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5cbaef0d-100a-47d8-b622-2e5e3b5be4bc tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda82dd4c0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.367964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5cbaef0d-100a-47d8-b622-2e5e3b5be4bc tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 286 microversion: 2.1 time: 0.037896 Aug 30 04:35:16.369100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 494/1011] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:16 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:17.381892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-314a74e6-7aa9-40a5-a9d7-9acf774cdfad tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda81c5dc0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:17.411775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-314a74e6-7aa9-40a5-a9d7-9acf774cdfad tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 286 microversion: 2.1 time: 0.034339 Aug 30 04:35:17.412340 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 518/1012] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:17 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:18.424753 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0f4d07ec-08e0-42d7-9004-55db2565075f tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda806bc10>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:18.454037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0f4d07ec-08e0-42d7-9004-55db2565075f tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 286 microversion: 2.1 time: 0.033611 Aug 30 04:35:18.454618 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 495/1013] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:18 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:19.466989 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-443e2140-ff41-4e0c-a722-e972474acb36 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda82c7670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:19.497546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-443e2140-ff41-4e0c-a722-e972474acb36 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 286 microversion: 2.1 time: 0.034832 Aug 30 04:35:19.498122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 519/1014] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:19 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:20.507416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=21 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:20.508246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=9 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:20.512547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6ea24750-14b6-47ec-92dd-dfac707607d2 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda82dd4c0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:20.542414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6ea24750-14b6-47ec-92dd-dfac707607d2 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 287 microversion: 2.1 time: 0.036099 Aug 30 04:35:20.543251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 496/1015] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:20 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:20.550973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:20.551791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:20.557140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c35400c4-d072-4491-b85c-1fe6ee5688ae tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda81c5d30>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:20.621953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c35400c4-d072-4491-b85c-1fe6ee5688ae tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 202 len: 0 microversion: 2.1 time: 0.071499 Aug 30 04:35:20.623043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 520/1016] 10.222.0.85 () {58 vars in 1254 bytes} [Tue Aug 30 04:35:20 2022] DELETE /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:20.632663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9e9d9d68-030f-4465-b20f-363cf214e012 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda82d48b0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:20.666687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9e9d9d68-030f-4465-b20f-363cf214e012 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 200 len: 286 microversion: 2.1 time: 0.037935 Aug 30 04:35:20.667342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 497/1017] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:20 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:21.679437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b37aa04b-6b82-4200-8b4d-9fa380f7e2ec tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda3e9fee0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:21.705410 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-b37aa04b-6b82-4200-8b4d-9fa380f7e2ec tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] HTTP exception thrown: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b37aa04b-6b82-4200-8b4d-9fa380f7e2ec tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Request method failure captured: Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c HTTP/1.1 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOC1ON8lAtMG2cobLG3gfqWeKYkZ1W2gJ_cipm104UhImvrxwHetotG7V6HYkv5dIUcdsNZvNPu0JzQXLG6zS_P8tmcA14akopWUBlNip7-ubyYJ2nV5V1rLD46EQFcBm84ER0nMqatt8VtSuumgv3dfY37C9KRXo6kE0rcSY_CU18 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:21.708555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce5e96b987d1430e99fd55c317dfd544"}]}] Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: f01f50b99c5d4899ae94f29630d25913 Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'f34b4aa1-8717-4d66-a3d6-33f7180f762c'} Aug 30 04:35:21.710154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. (HTTP 404) (Request-ID: req-97e57cd6-4209-4d48-8ed2-011b378c98c1) Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.711208 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:35:21.712406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 04:35:21.714230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b37aa04b-6b82-4200-8b4d-9fa380f7e2ec tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Returning 404 to user: Snapshot f34b4aa1-8717-4d66-a3d6-33f7180f762c could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:21.715954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b37aa04b-6b82-4200-8b4d-9fa380f7e2ec tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c" status: 404 len: 111 microversion: 2.1 time: 0.034995 Aug 30 04:35:21.716908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 521/1018] 10.222.0.85 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:21 2022] GET /compute/v2.1/os-snapshots/f34b4aa1-8717-4d66-a3d6-33f7180f762c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:21.719264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-174ef7dd-21aa-4ad6-a163-3af3f4118a30 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda83e8430>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:21.778867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-174ef7dd-21aa-4ad6-a163-3af3f4118a30 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 202 len: 0 microversion: 2.1 time: 0.063774 Aug 30 04:35:21.779428 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 498/1019] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:21 2022] DELETE /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:21.788162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-399c02dc-3406-459d-b81b-9ee363af57db tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda3e9f670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:21.836510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-399c02dc-3406-459d-b81b-9ee363af57db tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 200 len: 344 microversion: 2.1 time: 0.051965 Aug 30 04:35:21.837174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 522/1020] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:35:21 2022] GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:22.748702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-717052429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-754690315", "security_groups": [{"name": "tempest-secgroup-smoke-1522422868"}], "block_device_mapping_v2": [{"uuid": "a3930443-3689-4241-aced-c757523e7f86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bb2295-ab1f-4755-bab5-38bb2e0a7b79"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:22.851118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7e3b0de0-fa96-41a3-9bbd-8698cf865cb8 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda82c78b0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:22.862372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] validate_networks() for [('05bb2295-ab1f-4755-bab5-38bb2e0a7b79', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:35:22.880026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-7e3b0de0-fa96-41a3-9bbd-8698cf865cb8 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] HTTP exception thrown: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7e3b0de0-fa96-41a3-9bbd-8698cf865cb8 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Request method failure captured: Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b HTTP/1.1 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOC1ON8lAtMG2cobLG3gfqWeKYkZ1W2gJ_cipm104UhImvrxwHetotG7V6HYkv5dIUcdsNZvNPu0JzQXLG6zS_P8tmcA14akopWUBlNip7-ubyYJ2nV5V1rLD46EQFcBm84ER0nMqatt8VtSuumgv3dfY37C9KRXo6kE0rcSY_CU18 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:22.882298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce5e96b987d1430e99fd55c317dfd544"}]}] Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: f01f50b99c5d4899ae94f29630d25913 Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '3893395d-24e3-49a7-a501-9df679c1a64b'} Aug 30 04:35:22.883869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. (HTTP 404) (Request-ID: req-a9687305-23a5-46ed-824e-161331207b59) Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.884789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:35:22.886590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:35:22.887755 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7e3b0de0-fa96-41a3-9bbd-8698cf865cb8 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Returning 404 to user: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7e3b0de0-fa96-41a3-9bbd-8698cf865cb8 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 404 len: 109 microversion: 2.1 time: 0.036922 Aug 30 04:35:22.888972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 523/1021] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:35:22 2022] GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:22.905693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ef80b1e0-47c8-4b07-b3fd-8b51c12fcb98 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda3ea6670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:22.935254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-ef80b1e0-47c8-4b07-b3fd-8b51c12fcb98 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] HTTP exception thrown: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ef80b1e0-47c8-4b07-b3fd-8b51c12fcb98 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Request method failure captured: Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b HTTP/1.1 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOC1ON8lAtMG2cobLG3gfqWeKYkZ1W2gJ_cipm104UhImvrxwHetotG7V6HYkv5dIUcdsNZvNPu0JzQXLG6zS_P8tmcA14akopWUBlNip7-ubyYJ2nV5V1rLD46EQFcBm84ER0nMqatt8VtSuumgv3dfY37C9KRXo6kE0rcSY_CU18 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:22.945488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce5e96b987d1430e99fd55c317dfd544"}]}] Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: f01f50b99c5d4899ae94f29630d25913 Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '3893395d-24e3-49a7-a501-9df679c1a64b'} Aug 30 04:35:22.947013 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. (HTTP 404) (Request-ID: req-092b1c41-e8a4-4d0e-81f9-2882fe2756f7) Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.947876 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:35:22.949667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:35:22.950855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ef80b1e0-47c8-4b07-b3fd-8b51c12fcb98 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Returning 404 to user: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ef80b1e0-47c8-4b07-b3fd-8b51c12fcb98 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 404 len: 109 microversion: 2.1 time: 0.050431 Aug 30 04:35:22.952060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 524/1022] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:22 2022] DELETE /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:22.957790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e4af7938-3263-412b-8f00-afe9800f6404 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Calling method '.version_select at 0x7fcda3e9f5e0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:22.987968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-e4af7938-3263-412b-8f00-afe9800f6404 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] HTTP exception thrown: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e4af7938-3263-412b-8f00-afe9800f6404 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Request method failure captured: Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b HTTP/1.1 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOC1ON8lAtMG2cobLG3gfqWeKYkZ1W2gJ_cipm104UhImvrxwHetotG7V6HYkv5dIUcdsNZvNPu0JzQXLG6zS_P8tmcA14akopWUBlNip7-ubyYJ2nV5V1rLD46EQFcBm84ER0nMqatt8VtSuumgv3dfY37C9KRXo6kE0rcSY_CU18 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:22.990031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce5e96b987d1430e99fd55c317dfd544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce5e96b987d1430e99fd55c317dfd544"}]}] Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: ce5e96b987d1430e99fd55c317dfd544 Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-640555447 Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: f01f50b99c5d4899ae94f29630d25913 Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-640555447-project Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '3893395d-24e3-49a7-a501-9df679c1a64b'} Aug 30 04:35:22.991609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. (HTTP 404) (Request-ID: req-7445a715-53f4-4eea-99ab-93acaa1d7816) Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.992578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:35:22.996964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:35:22.998391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e4af7938-3263-412b-8f00-afe9800f6404 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] Returning 404 to user: Volume 3893395d-24e3-49a7-a501-9df679c1a64b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e4af7938-3263-412b-8f00-afe9800f6404 tempest-VolumesSnapshotsTestJSON-640555447 tempest-VolumesSnapshotsTestJSON-640555447-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b" status: 404 len: 109 microversion: 2.1 time: 0.039989 Aug 30 04:35:23.000212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 525/1023] 10.222.0.85 () {58 vars in 1245 bytes} [Tue Aug 30 04:35:22 2022] GET /compute/v2.1/os-volumes/3893395d-24e3-49a7-a501-9df679c1a64b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:23.277488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:35:23.277914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:35:23.278398 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:35:23.278806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:35:23.279221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:35:23.288958 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.289651 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.290393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.291302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.291953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.292554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.310547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for project 18e4bf7297124da4b43ccaeda048f772. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:35:23.314592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for user 2625939a0b9a43d59452df9ba9982ecb and project 18e4bf7297124da4b43ccaeda048f772. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:35:23.372397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:35:23.374582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3930443-3689-4241-aced-c757523e7f86',volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:35:23.507288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8820c836-148e-4d09-98fb-0a9041745b2b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762882 Aug 30 04:35:23.508209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 499/1024] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:35:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:35:23.520752 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1b318a09-c97c-457c-a87e-8cdf0ff4ab78 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:23.521398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1b318a09-c97c-457c-a87e-8cdf0ff4ab78 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:23.597613 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1b318a09-c97c-457c-a87e-8cdf0ff4ab78 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:23.611474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1b318a09-c97c-457c-a87e-8cdf0ff4ab78 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1093 microversion: 2.1 time: 0.095588 Aug 30 04:35:23.612215 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 526/1025] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:23 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:24.633259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:24.633876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:24.641096 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.641589 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.642026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.642719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.643172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.643843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.706698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.714649 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e270d40b-82a5-4e9f-9cc5-b60052da88ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1191 microversion: 2.1 time: 0.085774 Aug 30 04:35:24.715211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 500/1026] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:24 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:25.735931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:25.736562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:25.743588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:25.744788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:25.745321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:25.746036 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:25.746495 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:25.747098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:25.818715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:25.830623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-df591bb9-6063-4fcd-b350-ccebffffda68 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1209 microversion: 2.1 time: 0.098876 Aug 30 04:35:25.847102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 527/1027] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:25 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:26.856855 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:26.857666 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:26.864913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.865787 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.866504 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.867443 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.867937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.868430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.993082 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-0eeffa2c-98ba-4368-991f-a78671800b21 req-d82d5546-e082-4ad0-b6fd-61b13d437b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c3ec45-de91-4e52-8acd-9cfc102347fb", "tag": "269f69bd-5a62-467c-988c-152c585930d9"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:27.010391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0eeffa2c-98ba-4368-991f-a78671800b21 req-d82d5546-e082-4ad0-b6fd-61b13d437b0c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:27.011793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0eeffa2c-98ba-4368-991f-a78671800b21 req-d82d5546-e082-4ad0-b6fd-61b13d437b0c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:27.012483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0eeffa2c-98ba-4368-991f-a78671800b21 req-d82d5546-e082-4ad0-b6fd-61b13d437b0c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:27.028048 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-0eeffa2c-98ba-4368-991f-a78671800b21 req-d82d5546-e082-4ad0-b6fd-61b13d437b0c service nova] Creating event network-changed:269f69bd-5a62-467c-988c-152c585930d9 for instance 55c3ec45-de91-4e52-8acd-9cfc102347fb on hv-cinder-85426 Aug 30 04:35:27.038701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-0eeffa2c-98ba-4368-991f-a78671800b21 req-d82d5546-e082-4ad0-b6fd-61b13d437b0c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053019 Aug 30 04:35:27.040210 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 528/1028] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:27.145251 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:27.170433 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d623c72e-7ad4-4123-b5db-58c403511204 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.319605 Aug 30 04:35:27.171155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 501/1029] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:26 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:28.193080 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.194434 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:28.201348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.201843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.202282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.202991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.203439 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.204163 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.362269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:28.370501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ae224cad-002f-4072-9033-7228b1d933c2 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.182216 Aug 30 04:35:28.371250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 529/1030] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:28 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:29.392068 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.392615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.399162 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.399638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.400064 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.400747 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.401229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.401654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.532451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:29.540133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2c4f3373-755d-48d7-acaf-5c329d73e1a9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.152021 Aug 30 04:35:29.540700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 502/1031] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:29 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:30.094431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:30.095044 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.101612 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.102095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.102525 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.103224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.103673 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.104096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.128360 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lazy-loading 'flavor' on Instance uuid f88ba488-5a94-48a0-80c6-2df40d20372e {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:35:30.208334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9bc007c3-1f90-4db1-81ea-15a8e4357849 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "POST /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e/action" status: 202 len: 0 microversion: 2.1 time: 0.117643 Aug 30 04:35:30.208928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 530/1032] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:35:30 2022] POST /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:30.218059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.218913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.224942 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.225537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.225881 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.226564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.227065 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.227417 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.367938 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:30.375582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9fa843e3-163d-4e01-b55c-4c1e6341be7e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.161983 Aug 30 04:35:30.376144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 503/1033] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:30 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:30.561437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.562123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.568788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.569425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.569869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.570578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.571041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.571470 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.992387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.000889 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-02bbc214-4423-49b0-ab27-51d68ca5e47c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.443767 Aug 30 04:35:31.001492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 531/1034] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:30 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:31.396605 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.397225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.404252 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.404732 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.405263 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.405961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.406413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.406837 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.561436 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.571039 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0fb3fc25-fa95-417a-803a-a7c30568609a tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.178244 Aug 30 04:35:31.571614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 504/1035] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:31 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:32.021577 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:32.022202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:32.029212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.029973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.030416 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.031106 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.031584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.032007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.178500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:32.186826 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5075ba92-92ce-4f81-8ff8-88f5f7930d6f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.169210 Aug 30 04:35:32.187404 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 532/1036] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:32 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:32.592171 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:32.593014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:32.600016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.600537 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.600972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.601844 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.602299 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.602717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.740177 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:32.748897 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-97bc0f5d-832b-441c-8bf4-bc1eb74d29b0 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.160799 Aug 30 04:35:32.749689 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 505/1037] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:32 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:33.207961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:33.208584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:33.216572 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.217099 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.217546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.218282 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.218873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.219494 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.367287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:33.376961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6cdff28f-4a5a-4522-8fcc-65345956e87f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.172904 Aug 30 04:35:33.377610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 533/1038] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:33 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:33.770302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:33.770915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:33.776126 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:33.776126 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:33.780680 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.781182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.781607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.782302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.782914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.783339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.930041 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:33.938501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bec4403f-6761-45de-86b3-293678d1d2cb tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.172121 Aug 30 04:35:33.939311 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 506/1039] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:33 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:34.399047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:34.399794 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:34.402396 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:34.408491 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.408991 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.409464 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.410179 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.410643 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.411073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.549564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:34.557687 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-91fe57c0-460f-478a-bac8-6ab3f806497a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.162685 Aug 30 04:35:34.558286 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 534/1040] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:34 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:34.960272 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:34.960939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:34.968368 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.968857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.969345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.970042 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.970499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.970919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.124015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:35.132658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-df3e3e2a-a276-4491-a9c1-25c596e7ef0b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.176141 Aug 30 04:35:35.133270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 507/1041] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:34 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:35.578257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:35.578998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:35.585455 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.585947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.586385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.587089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.587688 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.588161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.774907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:35.783593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aea2e3aa-ed8a-4a19-a368-93509bd8078c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.209213 Aug 30 04:35:35.784165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 535/1042] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:35 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:36.155293 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:36.155914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:36.162483 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.162972 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.163407 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.164119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.164538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.164958 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.300429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:36.308448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-93847193-ce5a-4c49-827d-d5eafa9928f9 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.157461 Aug 30 04:35:36.309013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 508/1043] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:36 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:36.809619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:36.809619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:36.814120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.814608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.815047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.815747 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.816206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.816641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.946252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:36.955963 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f6195819-58b6-47d7-8470-b70b5bf80b5a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.153419 Aug 30 04:35:36.956563 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 536/1044] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:36 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:37.242213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-40b77189-fb27-453e-81a3-f742b2911f9a req-e12b32d2-bf5f-4ae1-b7f3-b8bd663a3732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c3ec45-de91-4e52-8acd-9cfc102347fb", "name": "network-vif-plugged", "status": "completed", "tag": "269f69bd-5a62-467c-988c-152c585930d9"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:37.253635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-40b77189-fb27-453e-81a3-f742b2911f9a req-e12b32d2-bf5f-4ae1-b7f3-b8bd663a3732 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.254341 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-40b77189-fb27-453e-81a3-f742b2911f9a req-e12b32d2-bf5f-4ae1-b7f3-b8bd663a3732 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.254830 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-40b77189-fb27-453e-81a3-f742b2911f9a req-e12b32d2-bf5f-4ae1-b7f3-b8bd663a3732 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.266835 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-40b77189-fb27-453e-81a3-f742b2911f9a req-e12b32d2-bf5f-4ae1-b7f3-b8bd663a3732 service nova] Creating event network-vif-plugged:269f69bd-5a62-467c-988c-152c585930d9 for instance 55c3ec45-de91-4e52-8acd-9cfc102347fb on hv-cinder-85426 Aug 30 04:35:37.272021 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-40b77189-fb27-453e-81a3-f742b2911f9a req-e12b32d2-bf5f-4ae1-b7f3-b8bd663a3732 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033583 Aug 30 04:35:37.273183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 509/1045] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:37.329946 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.330636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.336855 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.337604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.338198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.339603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.340058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.340479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.485253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:37.496065 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f792b46c-f975-452f-8460-16ae790e570e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.170101 Aug 30 04:35:37.497354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 537/1046] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:37.977383 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.978081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.984384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.984859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.985310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.985995 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.986438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.986853 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:38.125608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:38.133924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a4d9d053-b214-45a9-aa0f-8e333071ef8a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1265 microversion: 2.1 time: 0.161415 Aug 30 04:35:38.134424 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 510/1047] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:38.516987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:38.517622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:38.524001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.524477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.525127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:38.525818 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.526266 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.526683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:38.667289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:38.676922 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cd8ecbdf-a320-40ef-a9ef-13ec7c6ed895 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.163707 Aug 30 04:35:38.689211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 538/1048] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:38 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:39.156389 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.157254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.163918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.164547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.164993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.165929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.167019 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.167460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.310915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:39.318695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-15db7a5a-afb5-4cda-a5d3-e2da1edf0ee3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1453 microversion: 2.1 time: 0.166423 Aug 30 04:35:39.319276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 511/1049] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:39.339870 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.340576 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.346770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.347334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.347859 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.348627 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.349190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.349683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.486961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:39.495336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-270c4a47-5a81-4c83-b3a1-1ff254eceb99 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1453 microversion: 2.1 time: 0.160118 Aug 30 04:35:39.495906 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 539/1050] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:39.699497 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:39.700339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:39.710720 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.711223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.711791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.712509 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:39.712955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:39.713608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.861575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:39.870956 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-40e3b0c1-28c1-47eb-81ed-ab321dc2650b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.175759 Aug 30 04:35:39.871680 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 512/1051] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:39 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:40.891977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:40.892678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:40.899032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.899764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.900260 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.901227 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.901887 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.902500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:41.070129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:41.079198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-247d07c4-07ed-454b-85ee-35daacbfded2 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.190927 Aug 30 04:35:41.079967 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 540/1052] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:40 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:41.990098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-8ef46dd1-5191-4205-97d6-01a03735ebad req-d38f5faa-eaab-4e14-98e7-f5375a1cb33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c3ec45-de91-4e52-8acd-9cfc102347fb", "tag": "269f69bd-5a62-467c-988c-152c585930d9"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:42.002123 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8ef46dd1-5191-4205-97d6-01a03735ebad req-d38f5faa-eaab-4e14-98e7-f5375a1cb33e service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.002886 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8ef46dd1-5191-4205-97d6-01a03735ebad req-d38f5faa-eaab-4e14-98e7-f5375a1cb33e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.003372 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8ef46dd1-5191-4205-97d6-01a03735ebad req-d38f5faa-eaab-4e14-98e7-f5375a1cb33e service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.018150 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-8ef46dd1-5191-4205-97d6-01a03735ebad req-d38f5faa-eaab-4e14-98e7-f5375a1cb33e service nova] Creating event network-changed:269f69bd-5a62-467c-988c-152c585930d9 for instance 55c3ec45-de91-4e52-8acd-9cfc102347fb on hv-cinder-85426 Aug 30 04:35:42.023635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-8ef46dd1-5191-4205-97d6-01a03735ebad req-d38f5faa-eaab-4e14-98e7-f5375a1cb33e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038691 Aug 30 04:35:42.025211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 513/1053] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:42.102510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:42.104333 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:42.116246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.116779 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.117206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.118070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.118535 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.118951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.306725 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:42.315824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a41756ed-ad28-43d5-b1b9-a39f84119b6d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.217898 Aug 30 04:35:42.325786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 541/1054] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:42 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:43.339769 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:43.340477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:43.348076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.348576 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.349015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.349905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.350524 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.351111 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.491473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:43.499902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-99289d52-d6f3-46ca-8db0-8c59e00bd73c tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.165797 Aug 30 04:35:43.500511 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 514/1055] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:43 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:43.653854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:43.656006 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:43.662616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.663108 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.663542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.664242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.664697 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.665140 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.668908 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:43.696938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5f5ee05f-3ee7-473e-b134-9c2f847247cc tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046956 Aug 30 04:35:43.698195 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 542/1056] 10.222.0.85 () {60 vars in 1343 bytes} [Tue Aug 30 04:35:43 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:43.766635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:43.767241 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:43.774701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.775320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.776225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.777273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.779799 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.780575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.812050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:43.880008 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:43.917542 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bc0eb5c1-2c41-4cd4-94d0-490cf2b3d2ae tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 204 len: 0 microversion: 2.20 time: 0.154032 Aug 30 04:35:43.918413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 515/1057] 10.222.0.85 () {60 vars in 1280 bytes} [Tue Aug 30 04:35:43 2022] DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:43.927484 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:43.928119 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:43.939173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.939664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.945233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:43.946322 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:43.947968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:43.948626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:44.080581 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.089427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.090862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.092026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-94c5f889-3107-451a-b1b6-db4c15b82f14 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.169190 Aug 30 04:35:44.092580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 543/1058] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:43 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:44.522103 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:44.522832 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:44.529639 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:44.530119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:44.530540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:44.531216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:44.531656 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:44.532067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:44.668362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:44.676077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ba5e3bff-41fe-405c-8fad-3c28e4f2a7e1 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.158194 Aug 30 04:35:44.676638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 516/1059] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:44 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:45.115775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:45.116606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:45.124217 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.124707 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.125170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.125879 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.126358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.126768 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.266271 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.274330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.276448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.277646 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-71fd2c76-5629-4422-b09f-5a77f2dbd002 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.165956 Aug 30 04:35:45.278216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 544/1060] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:45 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:45.696918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:45.698156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:45.704584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.705092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.705550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.706241 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:45.706690 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:45.707109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:45.833786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:45.841534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7c8f53a1-172f-4b33-aa18-a9b80f452a73 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.148456 Aug 30 04:35:45.842098 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 517/1061] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:45 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:46.300964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.301601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.308981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.309499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.309933 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.310624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.311075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.311497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.439505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:46.447559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:46.449181 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:46.450375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77b159e2-3865-4b1a-ba10-f6334960227b tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.153664 Aug 30 04:35:46.450935 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 545/1062] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:46 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:46.862692 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.863306 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.869746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.870227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.870660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.871348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.871798 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.872220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.002158 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:47.009817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7f06aadc-d8e5-4271-9fb5-0d83e1fa157d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.151347 Aug 30 04:35:47.010887 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 518/1063] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:46 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:47.473976 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:47.474670 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:47.481737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.482222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.482666 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.483361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.484098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.484508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.613665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:47.622405 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:47.623848 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:47.625022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-79a4fc33-6fd3-460f-9771-48b8c4594f59 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.155423 Aug 30 04:35:47.625783 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 546/1064] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:47 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:48.031764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:48.032180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:48.038717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.039191 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.039617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.040350 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.040795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.041239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.172446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.180290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6a087f9f-ad50-4db4-baec-f92df66f7296 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.152760 Aug 30 04:35:48.180866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 519/1065] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:48 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:48.235699 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-5a8f27ed-9330-4d6d-aede-2b4ccdfa9708 req-560dc521-4a91-4ef1-9bdf-5a57168c0155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "name": "network-vif-unplugged", "status": "completed", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:48.255768 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-5a8f27ed-9330-4d6d-aede-2b4ccdfa9708 req-560dc521-4a91-4ef1-9bdf-5a57168c0155 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.255881 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-5a8f27ed-9330-4d6d-aede-2b4ccdfa9708 req-560dc521-4a91-4ef1-9bdf-5a57168c0155 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.256227 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-5a8f27ed-9330-4d6d-aede-2b4ccdfa9708 req-560dc521-4a91-4ef1-9bdf-5a57168c0155 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.270797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-5a8f27ed-9330-4d6d-aede-2b4ccdfa9708 req-560dc521-4a91-4ef1-9bdf-5a57168c0155 service nova] Creating event network-vif-unplugged:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:35:48.277440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-5a8f27ed-9330-4d6d-aede-2b4ccdfa9708 req-560dc521-4a91-4ef1-9bdf-5a57168c0155 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045749 Aug 30 04:35:48.278557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 547/1066] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:48.646971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:48.647531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:48.654048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.654530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.654963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.655645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.656097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.656519 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.783780 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.792502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.793970 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:48.795464 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-64e1b664-87cb-476a-a87d-9571df1b2287 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1724 microversion: 2.20 time: 0.152256 Aug 30 04:35:48.796229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 520/1067] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:48 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:49.202472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.203475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.209728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.210290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.210804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.211569 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.212024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.212446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.391917 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:49.400965 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-47c5773b-8314-4bf6-8493-f5fb7f9def24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1570 microversion: 2.1 time: 0.203641 Aug 30 04:35:49.401711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 548/1068] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:49 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:49.424048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:49.424672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.433218 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.434087 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.434853 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.436430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.437131 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.437957 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.470491 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120715) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:35:49.560148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e461c57c-34ad-40ce-9009-6bf96e7390e4 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "POST /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e/action" status: 202 len: 0 microversion: 2.1 time: 0.140460 Aug 30 04:35:49.560983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 521/1069] 10.222.0.85 () {60 vars in 1278 bytes} [Tue Aug 30 04:35:49 2022] POST /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:49.570516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.572184 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.580817 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.581408 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.582147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.583113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.584386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.585211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.751830 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:49.760147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3216bd0c-c168-42c3-af1f-23354e5d08bd tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1518 microversion: 2.1 time: 0.194464 Aug 30 04:35:49.760732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 549/1070] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:49 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:49.822642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.827582 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.836607 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.838067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.838760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.839731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.840836 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.841546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.893218 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-00a6164e-eeb5-4939-b7f3-8c8a6e39c2a0 req-feb53f4d-9708-4ca8-97f8-ebc62f74f6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05746cb-13ab-4eb9-961b-09d7254f6ce5", "name": "network-vif-deleted", "tag": "6a20448d-3686-45d0-84c7-615528a03b7c"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:49.918745 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-00a6164e-eeb5-4939-b7f3-8c8a6e39c2a0 req-feb53f4d-9708-4ca8-97f8-ebc62f74f6bf service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.919482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-00a6164e-eeb5-4939-b7f3-8c8a6e39c2a0 req-feb53f4d-9708-4ca8-97f8-ebc62f74f6bf service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.919942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-00a6164e-eeb5-4939-b7f3-8c8a6e39c2a0 req-feb53f4d-9708-4ca8-97f8-ebc62f74f6bf service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.962471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-00a6164e-eeb5-4939-b7f3-8c8a6e39c2a0 req-feb53f4d-9708-4ca8-97f8-ebc62f74f6bf service nova] Creating event network-vif-deleted:6a20448d-3686-45d0-84c7-615528a03b7c for instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 on hv-cinder-85426 Aug 30 04:35:49.974361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-00a6164e-eeb5-4939-b7f3-8c8a6e39c2a0 req-feb53f4d-9708-4ca8-97f8-ebc62f74f6bf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085841 Aug 30 04:35:49.977644 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 550/1071] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:50.036647 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.050393 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.063227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b05dcf62adc949c79b37c92bb3e09e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb4049582c4beaa9defa2fe20c8b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.064850 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-88770011-e8fd-4936-b40a-ab33c72982b2 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 200 len: 1657 microversion: 2.20 time: 0.249768 Aug 30 04:35:50.065797 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 522/1072] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:49 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 1657 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:50.782962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:50.783948 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:50.785942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=53 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:50.792117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.792605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.793048 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.793895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:50.794353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:50.794770 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.937738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:50.945997 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5dd2a4c4-577f-45a5-b0b0-a703b58705b3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1520 microversion: 2.1 time: 0.168064 Aug 30 04:35:50.946564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 551/1073] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:50 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:51.088616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:51.089290 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:51.093121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:51.099180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.099848 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.100489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.101225 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.101675 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.102092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.127390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] HTTP exception thrown: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Request method failure captured: Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 HTTP/1.1 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZHSFmZjDyW2w81E82yc71fmHOPAQruo30fKpq0QtYQUCaF7GoKy8niOdVSm5ZnH2icGjKygHSCDgZm0cNF8MPTXs-6dUCtgqV-HOtH1upcOULqfZOs8TJtyPkdGwrLoo-io1UJ9Pe6UmlKLtjFaH2yU8QxOAIbRclUIv_aUqS8TmrE Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:35:51.129148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8afb4049582c4beaa9defa2fe20c8b52"}]}] Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: b05dcf62adc949c79b37c92bb3e09e8e Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:51.130765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'd05746cb-13ab-4eb9-961b-09d7254f6ce5'} Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:51.131595 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:51.133205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:51.136173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Returning 404 to user: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:51.136173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52ffffe3-3f72-4168-bb5b-99ba549d711e tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 404 len: 111 microversion: 2.20 time: 0.046625 Aug 30 04:35:51.136173 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 523/1074] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:51 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:35:51.140077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-26697fb2-7963-4ce7-aa4e-4488875f2f74 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '.version_select at 0x7fcda8119670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:51.158362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-26697fb2-7963-4ce7-aa4e-4488875f2f74 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622479320" status: 204 len: 0 microversion: 2.20 time: 0.022161 Aug 30 04:35:51.158916 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 552/1075] 10.222.0.85 () {60 vars in 1262 bytes} [Tue Aug 30 04:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622479320 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:51.968812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:51.969438 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:51.975348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.975849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.976285 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.976989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.977461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.977882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.113060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:52.121245 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-17bed2b5-5373-41ff-ba8f-ac5532b38ec6 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.156642 Aug 30 04:35:52.121800 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 524/1076] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:51 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:52.943611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:52.944733 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:52.952074 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.952894 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.953621 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.955050 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.955513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.955934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.970586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] HTTP exception thrown: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Request method failure captured: Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 HTTP/1.1 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZHSFmZjDyW2w81E82yc71fmHOPAQruo30fKpq0QtYQUCaF7GoKy8niOdVSm5ZnH2icGjKygHSCDgZm0cNF8MPTXs-6dUCtgqV-HOtH1upcOULqfZOs8TJtyPkdGwrLoo-io1UJ9Pe6UmlKLtjFaH2yU8QxOAIbRclUIv_aUqS8TmrE Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:52.972279 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8afb4049582c4beaa9defa2fe20c8b52"}]}] Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: b05dcf62adc949c79b37c92bb3e09e8e Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:52.973871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'd05746cb-13ab-4eb9-961b-09d7254f6ce5'} Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:52.974624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:52.975853 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:52.978211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Returning 404 to user: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:52.979776 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0c68d891-606a-4c79-8fba-11b0aa28a25d tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 404 len: 111 microversion: 2.20 time: 0.040457 Aug 30 04:35:52.983901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 553/1077] 10.222.0.85 () {60 vars in 1280 bytes} [Tue Aug 30 04:35:52 2022] DELETE /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:35:52.989007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:52.989635 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: d05746cb-13ab-4eb9-961b-09d7254f6ce5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:52.997081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.997570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.997997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.998684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.999234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.999544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.018810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] HTTP exception thrown: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Request method failure captured: Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 HTTP/1.1 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZHSFmZjDyW2w81E82yc71fmHOPAQruo30fKpq0QtYQUCaF7GoKy8niOdVSm5ZnH2icGjKygHSCDgZm0cNF8MPTXs-6dUCtgqV-HOtH1upcOULqfZOs8TJtyPkdGwrLoo-io1UJ9Pe6UmlKLtjFaH2yU8QxOAIbRclUIv_aUqS8TmrE Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:35:53.020366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8afb4049582c4beaa9defa2fe20c8b52"}]}] Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: b05dcf62adc949c79b37c92bb3e09e8e Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:53.021846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'd05746cb-13ab-4eb9-961b-09d7254f6ce5'} Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:53.022597 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. Aug 30 04:35:53.023851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:53.024976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Returning 404 to user: Instance d05746cb-13ab-4eb9-961b-09d7254f6ce5 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:53.024976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f17655ff-397e-4e51-8dc7-d809c887bf78 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5" status: 404 len: 111 microversion: 2.20 time: 0.036625 Aug 30 04:35:53.024976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 525/1078] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:52 2022] GET /compute/v2.1/servers/d05746cb-13ab-4eb9-961b-09d7254f6ce5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:35:53.142284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:53.142956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:53.151209 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.151702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.152130 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.152839 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.153313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.153735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.314788 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:53.333516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-966738ff-b950-46b8-836a-28dd5a908780 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.194849 Aug 30 04:35:53.334115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 554/1079] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:53 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:54.199788 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.200325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.206765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.207247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.207674 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.208348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.208793 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.209239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.222953 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] HTTP exception thrown: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Request method failure captured: Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 HTTP/1.1 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZHSFmZjDyW2w81E82yc71fmHOPAQruo30fKpq0QtYQUCaF7GoKy8niOdVSm5ZnH2icGjKygHSCDgZm0cNF8MPTXs-6dUCtgqV-HOtH1upcOULqfZOs8TJtyPkdGwrLoo-io1UJ9Pe6UmlKLtjFaH2yU8QxOAIbRclUIv_aUqS8TmrE Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:35:54.224467 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8afb4049582c4beaa9defa2fe20c8b52"}]}] Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: b05dcf62adc949c79b37c92bb3e09e8e Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.226183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '0eaa5682-d37f-4718-af65-77b66b3963b7'} Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:54.226973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.228259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.229568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Returning 404 to user: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:54.229568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2b830fd0-29a7-40c9-9abc-5c00fed8b8b9 tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 404 len: 111 microversion: 2.20 time: 0.030740 Aug 30 04:35:54.229568 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 526/1080] 10.222.0.85 () {60 vars in 1280 bytes} [Tue Aug 30 04:35:54 2022] DELETE /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:35:54.234711 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.235324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] [instance: 0eaa5682-d37f-4718-af65-77b66b3963b7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.241671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.242148 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.242578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.243257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.243701 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.244118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.256968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] HTTP exception thrown: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Request method failure captured: Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 HTTP/1.1 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZHSFmZjDyW2w81E82yc71fmHOPAQruo30fKpq0QtYQUCaF7GoKy8niOdVSm5ZnH2icGjKygHSCDgZm0cNF8MPTXs-6dUCtgqV-HOtH1upcOULqfZOs8TJtyPkdGwrLoo-io1UJ9Pe6UmlKLtjFaH2yU8QxOAIbRclUIv_aUqS8TmrE Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:35:54.258501 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8afb4049582c4beaa9defa2fe20c8b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8afb4049582c4beaa9defa2fe20c8b52"}]}] Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8afb4049582c4beaa9defa2fe20c8b52 Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-893133254 Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: b05dcf62adc949c79b37c92bb3e09e8e Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-893133254-project Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.260640 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '0eaa5682-d37f-4718-af65-77b66b3963b7'} Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:54.261639 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. Aug 30 04:35:54.263110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:35:54.264617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] Returning 404 to user: Instance 0eaa5682-d37f-4718-af65-77b66b3963b7 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:54.264617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-53a44deb-ea64-48d6-aa68-2afc6dcccefa tempest-AttachVolumeShelveTestJSON-893133254 tempest-AttachVolumeShelveTestJSON-893133254-project] 10.222.0.85 "GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7" status: 404 len: 111 microversion: 2.20 time: 0.029191 Aug 30 04:35:54.264617 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 555/1081] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:54 2022] GET /compute/v2.1/servers/0eaa5682-d37f-4718-af65-77b66b3963b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:35:54.355506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.356113 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.362289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.362709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.363132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.363808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.364398 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.364820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.512072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:54.519914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-43960bc5-4eb0-44cb-a9ca-0e1d5c922e18 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.168217 Aug 30 04:35:54.520482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 527/1082] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:54 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:55.542303 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.542961 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.549549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.550113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.550641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.551409 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.551964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.552458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.684137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:55.693021 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d0a7a4b1-cc73-4120-abd6-6dd5c2b606c3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.155278 Aug 30 04:35:55.693618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 556/1083] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:55 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:56.714016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:56.714767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:56.721693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.722295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.722923 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.723709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.724264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.724780 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.868429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.876482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d1508f01-8f6e-412a-935c-d131c114c11e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.166320 Aug 30 04:35:56.877229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 528/1084] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:56 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:57.897854 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:57.898475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:57.906114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.906597 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.907026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.907717 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.908198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.908614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.048451 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:58.056378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6c1346bb-1edb-44d8-baf2-045a83365615 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.162262 Aug 30 04:35:58.057662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 557/1085] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:57 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:59.078863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:59.079479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:59.086227 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:59.086713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:59.087153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:59.088487 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:59.088945 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:59.089396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:59.252315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.262340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d05b1958-5a99-45db-89df-c46e99055c5b tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.187937 Aug 30 04:35:59.262925 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 529/1086] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:59 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:00.283528 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:00.284334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:00.293025 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.293614 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.294124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.295265 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.295492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.296127 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.528791 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:00.538229 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e8669bf1-2891-4c2e-b887-a412564c078d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.258533 Aug 30 04:36:00.538816 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 558/1087] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:00 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:01.559999 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:01.560773 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:01.567611 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.568097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.568526 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.569583 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.569881 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.570305 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.723625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:01.732456 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d5a40a55-4fba-482b-924f-5f392fad623d tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.176674 Aug 30 04:36:01.733547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 530/1088] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:01 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:02.754640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:02.755490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:02.762876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:02.763609 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:02.765119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.765900 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:02.767081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:02.767630 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.785761 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-23f47154-b057-4c61-92a7-0acad417cea5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: .version_select at 0x7fcda823be50>, body: {"keypair": {"name": "tempest-keypair-417962306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjblgvBZUcQWRBLY3seeszHdBvB6fmJrYk52WiMLaBDqQblbbNjWrXCW/od9vD3Kag2HGalaXQridnDujFqT4HFAsGnA9i5KCJvVX4/tlgL7MKUFvR8fyvQcwMaLi60xg=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:02.805505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-23f47154-b057-4c61-92a7-0acad417cea5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:02.810926 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-23f47154-b057-4c61-92a7-0acad417cea5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:02.834644 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-23f47154-b057-4c61-92a7-0acad417cea5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169396 Aug 30 04:36:02.835527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 559/1089] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:36:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:02.922301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:02.934042 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-519510be-d52d-4219-abd0-a879a2eddf26 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.183321 Aug 30 04:36:02.935362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 531/1090] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:02 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:03.853230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-7401d9a5-2a06-409a-a325-31326f77c5dc req-42a71539-b670-412a-852e-97846fe5dadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "name": "network-vif-plugged", "status": "completed", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:03.866126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7401d9a5-2a06-409a-a325-31326f77c5dc req-42a71539-b670-412a-852e-97846fe5dadd service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.866939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7401d9a5-2a06-409a-a325-31326f77c5dc req-42a71539-b670-412a-852e-97846fe5dadd service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.867822 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-7401d9a5-2a06-409a-a325-31326f77c5dc req-42a71539-b670-412a-852e-97846fe5dadd service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:03.889125 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-7401d9a5-2a06-409a-a325-31326f77c5dc req-42a71539-b670-412a-852e-97846fe5dadd service nova] Creating event network-vif-plugged:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:36:03.894678 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-7401d9a5-2a06-409a-a325-31326f77c5dc req-42a71539-b670-412a-852e-97846fe5dadd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045759 Aug 30 04:36:03.895511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 560/1091] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:03.955307 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:03.956608 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:03.963072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.963641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.964180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:03.964959 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.965672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.966168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:04.196067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:04.220311 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8a2bf4a4-e450-43d2-a522-615f13c93b57 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.269132 Aug 30 04:36:04.221373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 532/1092] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:03 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:04.358861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2033694261", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "028ab36d-9030-4e40-a42e-859885874e3a"}], "security_groups": [{"name": "tempest-securitygroup--1865577141"}], "key_name": "tempest-keypair-417962306", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:04.488428 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] validate_networks() for [('028ab36d-9030-4e40-a42e-859885874e3a', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:36:04.866786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:04.867376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:04.867708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:04.868115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:04.868530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:04.877871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:04.878562 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:04.878998 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:04.879723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:04.880355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:04.880772 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:04.899060 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:04.904159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:04.915425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:04.917850 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:04.965952 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-af46d5da-82a0-4017-84c5-56a69866cc24 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612953 Aug 30 04:36:04.966610 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 561/1093] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:04.977335 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ea1ccce9-efb3-4a63-bb70-c6a0188d2dc7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:04.977952 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ea1ccce9-efb3-4a63-bb70-c6a0188d2dc7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:05.033560 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ea1ccce9-efb3-4a63-bb70-c6a0188d2dc7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.040419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ea1ccce9-efb3-4a63-bb70-c6a0188d2dc7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1241 microversion: 2.1 time: 0.066986 Aug 30 04:36:05.041311 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 533/1094] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:04 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:05.253769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:05.254648 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:05.262907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:05.263405 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:05.263848 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:05.264580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:05.265201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:05.265507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:05.419806 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.428009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5e3f8a2d-742c-4149-a8fa-8aae584a5c8e tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1576 microversion: 2.1 time: 0.180994 Aug 30 04:36:05.428598 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 562/1095] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:05 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:06.060949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:06.062672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:06.070600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.071434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.072138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.072918 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.073471 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.073962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.093234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:06.144182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:06.152475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8e136b05-b895-43b9-9924-0246e375a137 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1237 microversion: 2.1 time: 0.095746 Aug 30 04:36:06.153073 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 534/1096] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:06 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:06.451677 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:06.452736 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:06.464115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.464608 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.465070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.465777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.466230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.466651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.615294 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:06.623995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7328bd8e-b880-4a3e-a9f2-561b74de9187 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1563 microversion: 2.1 time: 0.178142 Aug 30 04:36:06.624838 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 563/1097] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:06 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:07.173083 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:07.174255 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:07.181007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.182243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.182681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.183476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.183924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.185187 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.248059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:07.255991 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d0e40e11-08c8-4b78-ab53-d1c63cb81819 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1299 microversion: 2.1 time: 0.086800 Aug 30 04:36:07.256572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 535/1098] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:07 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:08.277015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:08.277667 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:08.284927 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.285381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.285827 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.286534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.287071 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.287517 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.349496 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-94acc958-53d1-4585-b158-4848db949396 req-2ddfdd5f-d89a-4f4f-a9b8-d6b945e78d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c85f91a-65a8-4467-a74e-e2101053764f", "tag": "76600936-3d50-49e5-9256-9cf624893de2"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:08.370591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-94acc958-53d1-4585-b158-4848db949396 req-2ddfdd5f-d89a-4f4f-a9b8-d6b945e78d7f service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.372205 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-94acc958-53d1-4585-b158-4848db949396 req-2ddfdd5f-d89a-4f4f-a9b8-d6b945e78d7f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.372872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-94acc958-53d1-4585-b158-4848db949396 req-2ddfdd5f-d89a-4f4f-a9b8-d6b945e78d7f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.387803 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-94acc958-53d1-4585-b158-4848db949396 req-2ddfdd5f-d89a-4f4f-a9b8-d6b945e78d7f service nova] Creating event network-changed:76600936-3d50-49e5-9256-9cf624893de2 for instance 6c85f91a-65a8-4467-a74e-e2101053764f on hv-cinder-85426 Aug 30 04:36:08.392738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-94acc958-53d1-4585-b158-4848db949396 req-2ddfdd5f-d89a-4f4f-a9b8-d6b945e78d7f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048048 Aug 30 04:36:08.393379 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 536/1099] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:08.485587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:08.489025 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:08.493554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f7a46e22-09a1-4d69-83f3-60bab3d1c1bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.220405 Aug 30 04:36:08.494686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 564/1100] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:08 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:09.516501 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:09.517303 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:09.523526 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:09.524015 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:09.524451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:09.525829 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:09.526287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:09.526712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:09.661586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.669232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-34123b78-e1fb-42df-956e-66fc3f0553b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.157747 Aug 30 04:36:09.669792 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 537/1101] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:09 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:10.690481 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:10.691115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:10.698120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.698595 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.699023 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.699700 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.700176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.700591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.826100 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:10.833527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77d4d8b6-55bf-4796-9e62-eb8faf3055b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.147212 Aug 30 04:36:10.834090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 565/1102] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:10 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:11.854602 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:11.855172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:11.861915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.862400 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.862838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.863535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.863987 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.864411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.995134 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:12.002729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a3484b88-3bb3-4421-8173-eeb7c02c6b6a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.152691 Aug 30 04:36:12.003289 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 538/1103] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:11 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:13.023426 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:13.023981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:13.030328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.030808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.031243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.031932 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.032381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.032802 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.209547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:13.217161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c183bede-5ade-48de-a630-f79095a52854 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.197700 Aug 30 04:36:13.217726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 566/1104] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:13 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:13.825538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-09a16528-c486-46d2-96bd-2163d36cc5da req-f847fb2c-e4a8-4574-b02a-18545c097cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c85f91a-65a8-4467-a74e-e2101053764f", "name": "network-vif-plugged", "status": "completed", "tag": "76600936-3d50-49e5-9256-9cf624893de2"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:13.838659 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-09a16528-c486-46d2-96bd-2163d36cc5da req-f847fb2c-e4a8-4574-b02a-18545c097cff service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:13.839137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-09a16528-c486-46d2-96bd-2163d36cc5da req-f847fb2c-e4a8-4574-b02a-18545c097cff service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:13.839771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-09a16528-c486-46d2-96bd-2163d36cc5da req-f847fb2c-e4a8-4574-b02a-18545c097cff service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.853594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-09a16528-c486-46d2-96bd-2163d36cc5da req-f847fb2c-e4a8-4574-b02a-18545c097cff service nova] Creating event network-vif-plugged:76600936-3d50-49e5-9256-9cf624893de2 for instance 6c85f91a-65a8-4467-a74e-e2101053764f on hv-cinder-85426 Aug 30 04:36:13.858833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-09a16528-c486-46d2-96bd-2163d36cc5da req-f847fb2c-e4a8-4574-b02a-18545c097cff service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037848 Aug 30 04:36:13.859615 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 539/1105] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:14.238716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:14.239358 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:14.246174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:14.246651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:14.247087 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:14.247764 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:14.248206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:14.248620 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:14.378851 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.386848 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f3814d57-f17f-4272-9b0d-61eebb25b2a3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.152045 Aug 30 04:36:14.387429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 567/1106] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:14 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:15.407684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:15.408392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:15.410878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:15.416451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.416926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.417385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.418071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.418541 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.418947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.610526 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:15.619119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fb0d75ae-3a33-4655-a23c-90980eeed0b5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1367 microversion: 2.1 time: 0.215265 Aug 30 04:36:15.619681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 540/1107] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:15 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:16.639606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:16.640220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:16.642086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:16.642875 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=10 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:16.650553 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.651038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.651473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.652169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.652622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.653120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.782194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:16.790016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1401fb95-bb9e-499d-aff2-dd163492a0b6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1558 microversion: 2.1 time: 0.154275 Aug 30 04:36:16.790662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 568/1108] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:16 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:16.811448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:16.812005 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:16.818404 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.818878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.819306 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.819989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.820442 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.820863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.899135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8593fdd7-39ae-4545-ac89-b6def7b8faa3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091757 Aug 30 04:36:16.900382 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 541/1109] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:36:16 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:17.819335 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-ff6e55fb-db81-479a-94c5-f2781b8f9ffc req-9120d705-413b-4e63-b185-16ddabe64062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c85f91a-65a8-4467-a74e-e2101053764f", "tag": "76600936-3d50-49e5-9256-9cf624893de2"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:17.829899 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ff6e55fb-db81-479a-94c5-f2781b8f9ffc req-9120d705-413b-4e63-b185-16ddabe64062 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:17.830448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ff6e55fb-db81-479a-94c5-f2781b8f9ffc req-9120d705-413b-4e63-b185-16ddabe64062 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:17.830945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ff6e55fb-db81-479a-94c5-f2781b8f9ffc req-9120d705-413b-4e63-b185-16ddabe64062 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:17.844177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-ff6e55fb-db81-479a-94c5-f2781b8f9ffc req-9120d705-413b-4e63-b185-16ddabe64062 service nova] Creating event network-changed:76600936-3d50-49e5-9256-9cf624893de2 for instance 6c85f91a-65a8-4467-a74e-e2101053764f on hv-cinder-85426 Aug 30 04:36:17.850216 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-ff6e55fb-db81-479a-94c5-f2781b8f9ffc req-9120d705-413b-4e63-b185-16ddabe64062 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034699 Aug 30 04:36:17.851078 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 569/1110] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:01.734893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:37:01.735473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Tue Aug 30 04:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/ips (ip 10.222.0.85) !!! Aug 30 04:37:01.735961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=39 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:01.736725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=34 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:01.741449 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:01.741931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:01.750308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.750782 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.751206 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.751916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.752356 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.752772 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.776124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-50a746ba-27d5-404e-b509-d15f12a268bf tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/ips" status: 200 len: 150 microversion: 2.1 time: 0.042926 Aug 30 04:37:01.776681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 542/1111] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:37:01 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:03.126468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f814553c-2fd0-4f9a-927f-3fde08742028"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:03.128901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:03.131689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:03.132332 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=26 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:03.139225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.139710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.140142 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.140831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.141313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.141736 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.410112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e4d8bd6c-f40d-4c7c-aadb-bc5657e377ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287750 Aug 30 04:37:03.410909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 570/1112] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:37:03 2022] POST /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:10.929698 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7ef4947c-6848-4b07-9708-c52e19d7e2ea tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: .version_select at 0x7fcda82d4040>, body: {"keypair": {"name": "tempest-keypair-1150974187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe31vj9yDioy9LIhNF9gTAUEXWOLFq0L+t6qkrJQuZ4ZFGm4cuWMKVT/jvCclxX9bKVBwB6h+0UAuPSW9gr1sT3YYlmmdHXt9/A33TcwpvOgzwOgDf6ri1TgcygYYhRIg=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:10.945965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-7ef4947c-6848-4b07-9708-c52e19d7e2ea tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:10.949755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-7ef4947c-6848-4b07-9708-c52e19d7e2ea tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:10.974391 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7ef4947c-6848-4b07-9708-c52e19d7e2ea tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048559 Aug 30 04:37:10.974966 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 543/1113] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:37:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:12.443837 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2017594072", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "028ab36d-9030-4e40-a42e-859885874e3a"}], "security_groups": [{"name": "tempest-securitygroup--478541500"}], "key_name": "tempest-keypair-1150974187", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:12.546713 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] validate_networks() for [('028ab36d-9030-4e40-a42e-859885874e3a', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:37:12.919623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:37:12.920070 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:37:12.920536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:37:12.920935 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:37:12.921361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:37:12.930010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.930530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.930959 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.932204 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.932650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.933084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.949284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:12.953170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:12.963807 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:37:12.966155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:37:13.011116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0af31c96-1d11-43cc-aac2-733581da0ca9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571906 Aug 30 04:37:13.011936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 571/1114] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:37:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:37:13.019441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:13.023928 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-611ddff4-c572-4635-b3b8-d539de8aa6d5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:13.024553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-611ddff4-c572-4635-b3b8-d539de8aa6d5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:13.079493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-611ddff4-c572-4635-b3b8-d539de8aa6d5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:13.086331 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-611ddff4-c572-4635-b3b8-d539de8aa6d5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1242 microversion: 2.1 time: 0.067679 Aug 30 04:37:13.086893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 544/1115] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:13 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:14.108175 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:14.108793 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:14.117224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:14.117718 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:14.118158 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:14.118940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:14.119317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:14.119741 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:14.184771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:14.192397 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-14239077-d6ec-4dab-8011-20ac90745930 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1294 microversion: 2.1 time: 0.089613 Aug 30 04:37:14.192971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 572/1116] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:14 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:15.214664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:15.215915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:15.222863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:15.223623 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:15.224172 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:15.224879 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:15.225362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:15.225794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:15.363634 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:15.372342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ed21960e-0310-4794-b6da-1ecc539ee4d6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1367 microversion: 2.1 time: 0.162197 Aug 30 04:37:15.373013 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 545/1117] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:15 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:15.864022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-b3e59893-7b3a-47dc-b441-b751d224a222 req-fb8d39a7-1530-443e-87cb-ab52770f0f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19610563-a97a-498d-9f7e-200b0bd70771", "tag": "1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:15.874432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b3e59893-7b3a-47dc-b441-b751d224a222 req-fb8d39a7-1530-443e-87cb-ab52770f0f41 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:15.875086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b3e59893-7b3a-47dc-b441-b751d224a222 req-fb8d39a7-1530-443e-87cb-ab52770f0f41 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:15.875738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b3e59893-7b3a-47dc-b441-b751d224a222 req-fb8d39a7-1530-443e-87cb-ab52770f0f41 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:15.887868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-b3e59893-7b3a-47dc-b441-b751d224a222 req-fb8d39a7-1530-443e-87cb-ab52770f0f41 service nova] Creating event network-changed:1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e for instance 19610563-a97a-498d-9f7e-200b0bd70771 on hv-cinder-85426 Aug 30 04:37:15.892915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-b3e59893-7b3a-47dc-b441-b751d224a222 req-fb8d39a7-1530-443e-87cb-ab52770f0f41 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110000 Aug 30 04:37:15.893623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 573/1118] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:16.392910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:16.393550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:16.400495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:16.400983 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:16.401444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:16.402230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:16.402574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:16.402997 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:16.532140 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:16.539866 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f8a81cf3-2a48-4ffd-86d2-64b51374d4ab tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1367 microversion: 2.1 time: 0.150946 Aug 30 04:37:16.541101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 546/1119] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:16 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:17.562147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:17.562852 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:17.569293 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.569785 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.570222 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.570928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.571383 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.572301 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.705537 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:17.714308 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-71408d3b-b1b0-4e79-8e61-3b4e587b0014 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1367 microversion: 2.1 time: 0.156974 Aug 30 04:37:17.715051 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 574/1120] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:17 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:18.735390 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:18.736001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:18.742381 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.742862 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.743293 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.743974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.744419 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.744839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.871249 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:18.878726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-451735a5-cd30-4d9d-bf3f-92f836e5826c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1367 microversion: 2.1 time: 0.147510 Aug 30 04:37:18.879323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 547/1121] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:18 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:19.900483 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:19.901440 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:19.907815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.908299 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.908737 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.909460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.909911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.910335 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.045549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:20.053429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4d3bf50e-066e-480a-a551-6d7e255e2f36 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1367 microversion: 2.1 time: 0.157477 Aug 30 04:37:20.054199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 575/1122] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:19 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:20.094448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-5a7e260c-c117-49b2-b8e9-24dead2f23bb req-60f1225f-ec22-484d-b51b-8b67ff57251f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19610563-a97a-498d-9f7e-200b0bd70771", "name": "network-vif-plugged", "status": "completed", "tag": "1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:20.105102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5a7e260c-c117-49b2-b8e9-24dead2f23bb req-60f1225f-ec22-484d-b51b-8b67ff57251f service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:20.110099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5a7e260c-c117-49b2-b8e9-24dead2f23bb req-60f1225f-ec22-484d-b51b-8b67ff57251f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:20.110099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5a7e260c-c117-49b2-b8e9-24dead2f23bb req-60f1225f-ec22-484d-b51b-8b67ff57251f service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.119859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-5a7e260c-c117-49b2-b8e9-24dead2f23bb req-60f1225f-ec22-484d-b51b-8b67ff57251f service nova] Creating event network-vif-plugged:1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e for instance 19610563-a97a-498d-9f7e-200b0bd70771 on hv-cinder-85426 Aug 30 04:37:20.125259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-5a7e260c-c117-49b2-b8e9-24dead2f23bb req-60f1225f-ec22-484d-b51b-8b67ff57251f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034494 Aug 30 04:37:20.125857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 548/1123] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:21.075034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:21.075645 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:21.082009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.082474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.082911 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.083616 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.084057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.084471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.214219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:21.221856 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-876f9e22-d548-453a-b969-3776c8ce9863 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1367 microversion: 2.1 time: 0.151309 Aug 30 04:37:21.222425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 576/1124] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:21 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:22.244961 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:22.245702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:22.252035 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.252593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.252964 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.253684 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.254137 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.254577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.393136 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:22.402580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-74b12c1f-238b-4631-8129-995624966a97 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1557 microversion: 2.1 time: 0.162687 Aug 30 04:37:22.403006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 549/1125] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:22 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:22.423312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:22.423777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:22.430361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.430846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.431325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.432019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.432504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.432930 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.508740 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-54968b3c-ed53-4693-8d8c-85d4955bdb21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089340 Aug 30 04:37:22.509411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 577/1126] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:37:22 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:23.432097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:23.492247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-e4bee068-3a9b-44aa-b8f2-0f62d62c0142 req-736e08b2-b180-40d8-be39-2d898ff20c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19610563-a97a-498d-9f7e-200b0bd70771", "tag": "1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:23.501642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4bee068-3a9b-44aa-b8f2-0f62d62c0142 req-736e08b2-b180-40d8-be39-2d898ff20c78 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:23.502189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4bee068-3a9b-44aa-b8f2-0f62d62c0142 req-736e08b2-b180-40d8-be39-2d898ff20c78 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:23.502679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4bee068-3a9b-44aa-b8f2-0f62d62c0142 req-736e08b2-b180-40d8-be39-2d898ff20c78 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:23.514036 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-e4bee068-3a9b-44aa-b8f2-0f62d62c0142 req-736e08b2-b180-40d8-be39-2d898ff20c78 service nova] Creating event network-changed:1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e for instance 19610563-a97a-498d-9f7e-200b0bd70771 on hv-cinder-85426 Aug 30 04:37:23.519183 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-e4bee068-3a9b-44aa-b8f2-0f62d62c0142 req-736e08b2-b180-40d8-be39-2d898ff20c78 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091738 Aug 30 04:37:23.520109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 550/1127] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:27.450849 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-bfe301a4-5166-4535-a6dc-9d4d8c3c70e6 req-1bc656d8-1b74-44b2-b5ee-527a0c9ac209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:27.452177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:27.452676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:27.454927 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:27.455605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:27.468809 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.469318 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.469750 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.470450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.470898 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.471323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.476847 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bfe301a4-5166-4535-a6dc-9d4d8c3c70e6 req-1bc656d8-1b74-44b2-b5ee-527a0c9ac209 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.477359 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bfe301a4-5166-4535-a6dc-9d4d8c3c70e6 req-1bc656d8-1b74-44b2-b5ee-527a0c9ac209 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.477788 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bfe301a4-5166-4535-a6dc-9d4d8c3c70e6 req-1bc656d8-1b74-44b2-b5ee-527a0c9ac209 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.489353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-bfe301a4-5166-4535-a6dc-9d4d8c3c70e6 req-1bc656d8-1b74-44b2-b5ee-527a0c9ac209 service nova] Creating event network-changed:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:37:27.494697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-bfe301a4-5166-4535-a6dc-9d4d8c3c70e6 req-1bc656d8-1b74-44b2-b5ee-527a0c9ac209 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048202 Aug 30 04:37:27.495297 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 551/1128] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:27.506364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:27.587109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2d55c047-3551-4d16-bad5-f2875449a9e7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 204 len: 0 microversion: 2.1 time: 0.145395 Aug 30 04:37:27.587915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 578/1129] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:27 2022] DELETE /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:37:27.596915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:27.597901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:27.604826 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.605624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.606239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.607490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.607970 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.608351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.742375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:27.750786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f857b748-284a-4457-ad8a-6688db34978f tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.158220 Aug 30 04:37:27.751353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 552/1130] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:27 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:28.772102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:28.772797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:28.779337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.779797 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.780223 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.780901 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.781374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.781790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.907619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:28.915893 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e2d2f365-460c-4050-bf57-509165446b55 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.147484 Aug 30 04:37:28.916448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 579/1131] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:28 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:29.936814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:29.937529 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:29.943971 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:29.944454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:29.944886 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:29.945599 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:29.946051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:29.946473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.088880 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:30.096861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8ddb13cb-6d5a-45ec-b446-469c24510851 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1569 microversion: 2.1 time: 0.163890 Aug 30 04:37:30.097658 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 553/1132] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:29 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:30.795458 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-45f4ab36-408c-4b3e-badd-000e9d07d295 req-248a2fb7-e694-409d-b4d6-4dd3e6f3846c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ba488-5a94-48a0-80c6-2df40d20372e", "name": "network-vif-deleted", "tag": "eeef7498-bb32-43b9-bc6e-1fe32f5be46b"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:30.808096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-45f4ab36-408c-4b3e-badd-000e9d07d295 req-248a2fb7-e694-409d-b4d6-4dd3e6f3846c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.808570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-45f4ab36-408c-4b3e-badd-000e9d07d295 req-248a2fb7-e694-409d-b4d6-4dd3e6f3846c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.808995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-45f4ab36-408c-4b3e-badd-000e9d07d295 req-248a2fb7-e694-409d-b4d6-4dd3e6f3846c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.821153 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-45f4ab36-408c-4b3e-badd-000e9d07d295 req-248a2fb7-e694-409d-b4d6-4dd3e6f3846c service nova] Creating event network-vif-deleted:eeef7498-bb32-43b9-bc6e-1fe32f5be46b for instance f88ba488-5a94-48a0-80c6-2df40d20372e on hv-cinder-85426 Aug 30 04:37:30.827824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-45f4ab36-408c-4b3e-badd-000e9d07d295 req-248a2fb7-e694-409d-b4d6-4dd3e6f3846c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035545 Aug 30 04:37:30.828705 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 580/1133] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:31.120260 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:31.121505 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:31.128696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.129221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.129661 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:31.130364 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.130810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.131230 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:31.196888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71c0e86c4b2456abce0e459705a2919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96907629895d451697f448cf2c3bc6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:31.204973 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fe8628be-aa75-41f6-89d6-eb20bc7df3a3 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 200 len: 1220 microversion: 2.1 time: 0.089728 Aug 30 04:37:31.205681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 554/1134] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:31 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:32.226138 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:32.226843 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] [instance: f88ba488-5a94-48a0-80c6-2df40d20372e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:32.233836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:32.234321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:32.234759 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:32.235446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:32.235905 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:32.236330 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:32.249941 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] HTTP exception thrown: Instance f88ba488-5a94-48a0-80c6-2df40d20372e could not be found. Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Request method failure captured: Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e HTTP/1.1 Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZLbbZt4GX-bQkHXkrUhmNVy_ugYQ8wzeIhlYYgQG4j9ISR4fgIUyJUiSGNb1dahueKaURqkLCThG_JCZC0quf7jg7CZE0YYco5PUmGpP2fbvDkb50ZEGf3PeVzNQKl_r5pi1aaIrVYxeWiRk_zlJtO1aCLnRUumaN5N-gqZwuYuaNc Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 96907629895d451697f448cf2c3bc6a1 Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestShelveInstance-1168836545 Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:37:32.251533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/96907629895d451697f448cf2c3bc6a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/96907629895d451697f448cf2c3bc6a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/96907629895d451697f448cf2c3bc6a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_96907629895d451697f448cf2c3bc6a1"}]}] Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestShelveInstance-1168836545 Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 96907629895d451697f448cf2c3bc6a1 Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestShelveInstance-1168836545 Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-TestShelveInstance-1168836545-project Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: a71c0e86c4b2456abce0e459705a2919 Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestShelveInstance-1168836545-project Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance f88ba488-5a94-48a0-80c6-2df40d20372e could not be found. Aug 30 04:37:32.253249 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'f88ba488-5a94-48a0-80c6-2df40d20372e'} Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f88ba488-5a94-48a0-80c6-2df40d20372e could not be found. Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:32.254220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f88ba488-5a94-48a0-80c6-2df40d20372e could not be found. Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f88ba488-5a94-48a0-80c6-2df40d20372e could not be found. Aug 30 04:37:32.255815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:32.257603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Returning 404 to user: Instance f88ba488-5a94-48a0-80c6-2df40d20372e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:32.257603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ae23670f-ee47-413e-b98b-5c7ac10f5f24 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e" status: 404 len: 111 microversion: 2.1 time: 0.031048 Aug 30 04:37:32.257603 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 581/1135] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:32 2022] GET /compute/v2.1/servers/f88ba488-5a94-48a0-80c6-2df40d20372e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:32.413463 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d34016c2-9746-4d6d-9c27-1e5e195be7d7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] Calling method '.version_select at 0x7fcda3d48820>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:32.422660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:32.437793 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d34016c2-9746-4d6d-9c27-1e5e195be7d7 tempest-TestShelveInstance-1168836545 tempest-TestShelveInstance-1168836545-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1415959040" status: 202 len: 0 microversion: 2.1 time: 0.028561 Aug 30 04:37:32.438385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 555/1136] 10.222.0.85 () {58 vars in 1254 bytes} [Tue Aug 30 04:37:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1415959040 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:47.473024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:47.473628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:47.476498 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.477302 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.483309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.483824 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.484292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.484982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.485462 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.485892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.514830 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:47.591559 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9d8333b0-1563-45e1-a9ac-2d0047e31b65 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "DELETE /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 204 len: 0 microversion: 2.1 time: 0.122349 Aug 30 04:37:47.592152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 582/1137] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:47 2022] DELETE /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:37:47.598099 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=48 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.598833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.602796 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:47.603399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:47.612000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.612484 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.612930 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.613671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.614121 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.614538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.752549 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:47.761295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d8aa98a2-4082-4d6d-a892-8f1dd8bd0a45 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1578 microversion: 2.1 time: 0.164570 Aug 30 04:37:47.761851 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 556/1138] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:47 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:48.783320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:48.784052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:48.790472 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:48.790957 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:48.791495 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:48.792727 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:48.793221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:48.793653 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:48.927233 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:48.934974 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-498d0940-bea6-4995-82a3-21403a2b6069 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1578 microversion: 2.1 time: 0.155898 Aug 30 04:37:48.935551 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 583/1139] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:48 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:49.955717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.956321 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:49.962667 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:49.963141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:49.963565 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:49.964243 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:49.964686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:49.965152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.096941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:50.105311 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5bbc32f7-462d-4eff-88dd-eb3a0e37b32c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1578 microversion: 2.1 time: 0.153442 Aug 30 04:37:50.110457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 557/1140] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:49 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:50.663235 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-c330599a-c0b5-48dc-841d-459241f906e4 req-d411062e-f080-4c9f-a563-b2ce63529034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c3ec45-de91-4e52-8acd-9cfc102347fb", "name": "network-vif-deleted", "tag": "269f69bd-5a62-467c-988c-152c585930d9"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:50.672778 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c330599a-c0b5-48dc-841d-459241f906e4 req-d411062e-f080-4c9f-a563-b2ce63529034 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.673368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c330599a-c0b5-48dc-841d-459241f906e4 req-d411062e-f080-4c9f-a563-b2ce63529034 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.673863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c330599a-c0b5-48dc-841d-459241f906e4 req-d411062e-f080-4c9f-a563-b2ce63529034 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.686101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-c330599a-c0b5-48dc-841d-459241f906e4 req-d411062e-f080-4c9f-a563-b2ce63529034 service nova] Creating event network-vif-deleted:269f69bd-5a62-467c-988c-152c585930d9 for instance 55c3ec45-de91-4e52-8acd-9cfc102347fb on hv-cinder-85426 Aug 30 04:37:50.691751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-c330599a-c0b5-48dc-841d-459241f906e4 req-d411062e-f080-4c9f-a563-b2ce63529034 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Aug 30 04:37:50.692591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 584/1141] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:51.130170 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:51.131416 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:51.138647 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:51.139149 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:51.139586 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:51.140511 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:51.141186 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:51.141616 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:51.205717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:51.213812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7ba625b3-aae3-4294-949b-c4ca67d19e38 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 200 len: 1224 microversion: 2.1 time: 0.087522 Aug 30 04:37:51.214388 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 558/1142] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:51 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:52.235475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:52.236206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:52.242429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.242924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.243367 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.244057 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.245200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.245800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.259081 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] HTTP exception thrown: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Request method failure captured: Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb HTTP/1.1 Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZNsUYcAT6LZ5wzFy8uN0JTWeZS1Y66GoGkYieppj4ljbqlb3l5I1xoinm9K6i5WFts-iJ3BZaaxDIZlRaKECDsPr9WD3mor_aHm6f5pdxjlC5-wZfzxue9RQoSr6NX-uHbwj9i0NwqvaAeZA0HoIeS_-wf4nKhHDC6ZlyH8xLDc6uM Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:37:52.261446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_18e4bf7297124da4b43ccaeda048f772"}]}] Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestVolumeBootPattern-362673499 Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 2625939a0b9a43d59452df9ba9982ecb Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:37:52.263090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '55c3ec45-de91-4e52-8acd-9cfc102347fb'} Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:52.264063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:37:52.265623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:37:52.266973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Returning 404 to user: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:52.266973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4fdc4fdc-4baf-4427-9541-fd50a1ee76fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 404 len: 111 microversion: 2.1 time: 0.032393 Aug 30 04:37:52.266973 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 585/1143] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:52 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:52.366312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1218818399", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-754690315", "security_groups": [{"name": "tempest-secgroup-smoke-1522422868"}], "block_device_mapping_v2": [{"uuid": "a3930443-3689-4241-aced-c757523e7f86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bb2295-ab1f-4755-bab5-38bb2e0a7b79"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:52.478017 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] validate_networks() for [('05bb2295-ab1f-4755-bab5-38bb2e0a7b79', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:37:52.952824 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:37:52.953377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:37:52.953839 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:37:52.954270 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:37:52.954686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:37:52.963344 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.963812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.964229 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.964939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.965410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.965821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.982723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for project 18e4bf7297124da4b43ccaeda048f772. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:52.986628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for user 2625939a0b9a43d59452df9ba9982ecb and project 18e4bf7297124da4b43ccaeda048f772. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:53.043446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:37:53.045625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3930443-3689-4241-aced-c757523e7f86',volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:37:53.170113 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4ce47a43-b0bf-4189-a61c-577ec5ac2c15 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807785 Aug 30 04:37:53.170758 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 559/1144] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:37:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:37:53.181527 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ccce129-c0e2-4802-bca6-53ed26e77896 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:53.182152 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ccce129-c0e2-4802-bca6-53ed26e77896 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:53.236630 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ccce129-c0e2-4802-bca6-53ed26e77896 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:53.243507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ccce129-c0e2-4802-bca6-53ed26e77896 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1094 microversion: 2.1 time: 0.065788 Aug 30 04:37:53.244064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 586/1145] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:53 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:54.264322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:54.264927 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:54.271461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.271934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.272361 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.273048 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.273499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.273916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.333994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:54.341648 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e0b0d044-73fa-4256-a17c-8c764b3f4358 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1192 microversion: 2.1 time: 0.081721 Aug 30 04:37:54.342210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 560/1146] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:54 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:55.362968 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:55.364202 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:55.371955 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.372744 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.373467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.374392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.375016 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.375605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.441475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.450252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6c423812-7b4d-4fee-bdd4-c8b186cdfa43 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1210 microversion: 2.1 time: 0.091027 Aug 30 04:37:55.451237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 587/1147] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:55 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:56.139364 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-15f1278e-dbed-4716-aace-51b1ee781627 req-67699aae-21cb-48d9-8011-929cf3f18998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8913aeda-b661-4c59-b19b-eb3252bf1047", "tag": "62ae85bd-5cc8-48f9-bbc5-06af77beba2a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:56.149867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-15f1278e-dbed-4716-aace-51b1ee781627 req-67699aae-21cb-48d9-8011-929cf3f18998 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.150657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-15f1278e-dbed-4716-aace-51b1ee781627 req-67699aae-21cb-48d9-8011-929cf3f18998 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.151085 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-15f1278e-dbed-4716-aace-51b1ee781627 req-67699aae-21cb-48d9-8011-929cf3f18998 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.162592 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-15f1278e-dbed-4716-aace-51b1ee781627 req-67699aae-21cb-48d9-8011-929cf3f18998 service nova] Creating event network-changed:62ae85bd-5cc8-48f9-bbc5-06af77beba2a for instance 8913aeda-b661-4c59-b19b-eb3252bf1047 on hv-cinder-85426 Aug 30 04:37:56.167882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-15f1278e-dbed-4716-aace-51b1ee781627 req-67699aae-21cb-48d9-8011-929cf3f18998 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031701 Aug 30 04:37:56.168562 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 561/1148] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:56.471819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:56.472537 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:56.479046 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.479532 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.479966 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.480663 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.481156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.481586 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.627990 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:56.636289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a804aab3-c9eb-45ba-aed6-3aec651247f3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.168054 Aug 30 04:37:56.637120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 588/1149] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:56 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:57.659323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:57.659942 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:57.666131 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.666613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.667598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.668298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.668750 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.669211 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.796766 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:57.804409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-26a71201-2c57-4cc3-b644-1ccc5f9a5074 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.149912 Aug 30 04:37:57.805081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 562/1150] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:57 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:58.825715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:58.826326 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:58.832907 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.833432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.833867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.834558 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.835010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.835437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.977499 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:58.986014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-49467e12-ed71-43a8-9468-65aaacc3c8de tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.164192 Aug 30 04:37:58.986582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 589/1151] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:58 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:00.006428 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:00.007051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:00.014164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:00.014679 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:00.015115 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:00.015804 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:00.016256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:00.016682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:00.147221 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:00.154940 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-35b7cd9f-96d7-499d-9ff3-9d9e13157b63 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.152352 Aug 30 04:38:00.155503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 563/1152] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:00 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:01.175939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:01.176550 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:01.183010 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.183493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.183928 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.184652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.185122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.185547 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.316589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:01.324909 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-015ae99f-af1b-4938-b397-3dc279a2b4a1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.152862 Aug 30 04:38:01.325509 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 590/1153] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:01 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:02.345377 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:02.346009 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:02.352339 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.352820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.353287 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.353980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.354429 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.354847 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.488941 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:02.496628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-55cf49ad-01cf-4f0e-8aa6-0a34d6b96f6d tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.155102 Aug 30 04:38:02.497209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 564/1154] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:02 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:03.516993 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:03.517618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:03.520120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:03.525867 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.526381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.526819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.528086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.528589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.529015 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.659373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:03.667014 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c8af4575-5784-49b3-921e-84ff3c7b6486 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.154090 Aug 30 04:38:03.667624 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 591/1155] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:03 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:04.687910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:04.688530 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:04.690507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.691333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.697925 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.698409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.698846 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.699538 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.699989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.700411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.832325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:04.839917 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cba7f441-a0cc-400a-b3d1-d5be8600f40b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.156654 Aug 30 04:38:04.840477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 565/1156] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:04 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:05.859951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:05.860568 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:05.867037 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.867521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.867956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.868675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.869151 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.869575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.997654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:06.005348 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0b7a0e41-1e23-4b89-8b82-a6b7f7f93cf8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.149468 Aug 30 04:38:06.005915 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 592/1157] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:05 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:06.451177 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-db8f53ec-f955-4f87-ad73-a5100f1e3788 req-125b7fe4-137f-4223-892f-60023450ba9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8913aeda-b661-4c59-b19b-eb3252bf1047", "name": "network-vif-plugged", "status": "completed", "tag": "62ae85bd-5cc8-48f9-bbc5-06af77beba2a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:06.461060 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-db8f53ec-f955-4f87-ad73-a5100f1e3788 req-125b7fe4-137f-4223-892f-60023450ba9a service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.461554 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-db8f53ec-f955-4f87-ad73-a5100f1e3788 req-125b7fe4-137f-4223-892f-60023450ba9a service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.461985 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-db8f53ec-f955-4f87-ad73-a5100f1e3788 req-125b7fe4-137f-4223-892f-60023450ba9a service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.473624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-db8f53ec-f955-4f87-ad73-a5100f1e3788 req-125b7fe4-137f-4223-892f-60023450ba9a service nova] Creating event network-vif-plugged:62ae85bd-5cc8-48f9-bbc5-06af77beba2a for instance 8913aeda-b661-4c59-b19b-eb3252bf1047 on hv-cinder-85426 Aug 30 04:38:06.478610 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-db8f53ec-f955-4f87-ad73-a5100f1e3788 req-125b7fe4-137f-4223-892f-60023450ba9a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154611 Aug 30 04:38:06.480106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 566/1158] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:06.939289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:06.939863 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.946206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.946682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.947113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.947800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.948242 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.948662 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.972411 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bb963b9e-d048-4d6d-aaf5-e6fbaa230065 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/ips" status: 200 len: 150 microversion: 2.1 time: 0.037010 Aug 30 04:38:06.972975 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 593/1159] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:38:06 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:06.985164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f814553c-2fd0-4f9a-927f-3fde08742028"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:06.987672 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.993854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.994345 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.994783 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.995470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.995924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.996353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.026357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:07.027681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:07.033944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.035767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.035767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.035767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.036076 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.036387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.074577 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Invalid volume: volume f814553c-2fd0-4f9a-927f-3fde08742028 is already attached to instances: 6c85f91a-65a8-4467-a74e-e2101053764f Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: POST /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/os-volume_attachments HTTP/1.1 Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 74 Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:38:07.076298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {"volumeAttachment": {"volumeId": "f814553c-2fd0-4f9a-927f-3fde08742028"}} Aug 30 04:38:07.077767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Invalid volume: volume f814553c-2fd0-4f9a-927f-3fde08742028 is already attached to instances: 6c85f91a-65a8-4467-a74e-e2101053764f Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'server_id': '19610563-a97a-498d-9f7e-200b0bd70771', 'body': {'volumeAttachment': {'volumeId': 'f814553c-2fd0-4f9a-927f-3fde08742028'}}} Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f814553c-2fd0-4f9a-927f-3fde08742028 is already attached to instances: 6c85f91a-65a8-4467-a74e-e2101053764f Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:38:07.078600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f814553c-2fd0-4f9a-927f-3fde08742028 is already attached to instances: 6c85f91a-65a8-4467-a74e-e2101053764f Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:07.080106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f814553c-2fd0-4f9a-927f-3fde08742028 is already attached to instances: 6c85f91a-65a8-4467-a74e-e2101053764f Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 400 to user: Invalid volume: volume f814553c-2fd0-4f9a-927f-3fde08742028 is already attached to instances: 6c85f91a-65a8-4467-a74e-e2101053764f {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3bdd8409-f62b-4c94-88c3-3218ae82cad2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097337 Aug 30 04:38:07.081617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 567/1160] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:38:06 2022] POST /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:38:07.086402 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:07.086896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:07.094356 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.094838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.095275 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.095965 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.096414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.096833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.123210 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:07.173549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:07.182161 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d7f5b1e7-acb5-41d5-9c43-d4593f1fa241 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.159595 Aug 30 04:38:07.182735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 594/1161] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:07 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:07.200037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a4858584-6e57-4c11-a31d-3b4643dc2523 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 204 len: 0 microversion: 2.1 time: 0.117082 Aug 30 04:38:07.200604 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 568/1162] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:07 2022] DELETE /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:38:07.208686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:07.209362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:07.217414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.217414 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.217817 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.218516 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.218969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.219398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.346987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:07.354693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bfa91431-0e53-41f8-8561-ca05bd904036 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1682 microversion: 2.1 time: 0.149880 Aug 30 04:38:07.355257 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 595/1163] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:07 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:08.203343 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:08.204050 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:08.210520 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.211002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.211436 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.212153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.212601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.213020 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.342653 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:08.350346 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4a4d9129-5da8-4046-9f05-a6f0a01acf1e tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.151276 Aug 30 04:38:08.350902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 569/1164] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:08 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:08.375682 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:08.376220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:08.382584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.383056 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.383482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.384159 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.384605 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.385017 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.519068 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:08.526942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b7d998fc-b32f-45ec-918c-a07f24622815 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1682 microversion: 2.1 time: 0.154978 Aug 30 04:38:08.528094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 596/1165] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:08 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:09.371043 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.372204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.378674 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.379153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.379585 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.380268 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.380718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.381165 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.507286 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:09.514914 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c89b7daf-ec1e-4f0c-9d37-2142cfa5ab18 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1266 microversion: 2.1 time: 0.147830 Aug 30 04:38:09.515477 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 570/1166] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:09 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:09.549019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.549665 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.556084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.556564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.557031 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.557743 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.558194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.558619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.689732 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:09.697530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e715a55d-8eac-4650-8740-c6adebdab15d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1682 microversion: 2.1 time: 0.152251 Aug 30 04:38:09.698176 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 597/1167] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:09 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:10.535700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:10.536312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:10.542919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.543451 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.543888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.544695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.545185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.545613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.678671 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.687055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6484650b-a6cc-4192-b1c1-3e1bf344367a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1454 microversion: 2.1 time: 0.155199 Aug 30 04:38:10.687626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 571/1168] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:10 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:10.708120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:10.708834 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:10.715415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.715984 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.716497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.717337 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.718054 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.718551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:10.718679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.719166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:10.725371 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.725907 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.726374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.727067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.727513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.727937 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.829454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.834550 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:10.840557 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-60f39e3a-4ffe-4997-8c96-b16b75aa556b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 200 len: 1615 microversion: 2.1 time: 0.125950 Aug 30 04:38:10.853637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 572/1169] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:10 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 1615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:10.899254 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.906987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c38b71a6-d4b0-494f-95cd-42337e0e4ccb tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1454 microversion: 2.1 time: 0.202907 Aug 30 04:38:10.907593 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 598/1170] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:10 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:11.062947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a6e37a0d-5958-40cd-8e2f-78ac1589dd75 req-b4fe0be9-5a62-4fe3-8877-637d06ef184d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19610563-a97a-498d-9f7e-200b0bd70771", "name": "network-vif-deleted", "tag": "1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:11.074144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a6e37a0d-5958-40cd-8e2f-78ac1589dd75 req-b4fe0be9-5a62-4fe3-8877-637d06ef184d service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.074644 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a6e37a0d-5958-40cd-8e2f-78ac1589dd75 req-b4fe0be9-5a62-4fe3-8877-637d06ef184d service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.075258 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a6e37a0d-5958-40cd-8e2f-78ac1589dd75 req-b4fe0be9-5a62-4fe3-8877-637d06ef184d service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.088084 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a6e37a0d-5958-40cd-8e2f-78ac1589dd75 req-b4fe0be9-5a62-4fe3-8877-637d06ef184d service nova] Creating event network-vif-deleted:1b3df022-6d7f-4f38-9f0d-dfc7e7b6621e for instance 19610563-a97a-498d-9f7e-200b0bd70771 on hv-cinder-85426 Aug 30 04:38:11.094629 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a6e37a0d-5958-40cd-8e2f-78ac1589dd75 req-b4fe0be9-5a62-4fe3-8877-637d06ef184d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Aug 30 04:38:11.095574 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 573/1171] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:11.863477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:11.864977 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:11.873480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.874084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.874594 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.875378 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.875904 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.876400 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.892111 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 HTTP/1.1 Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:38:11.894336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:38:11.895722 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '19610563-a97a-498d-9f7e-200b0bd70771'} Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:11.896521 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:38:11.897831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:11.900939 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:11.902073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-76d23b57-9435-48d5-a402-4c3667957afe tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 404 len: 111 microversion: 2.1 time: 0.043820 Aug 30 04:38:11.903492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 599/1172] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:11 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:11.912678 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-64fddcc3-6d61-4534-9d0a-4704bbc4bfeb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '.version_select at 0x7fcda8ea2700>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:11.935934 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-64fddcc3-6d61-4534-9d0a-4704bbc4bfeb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150974187" status: 202 len: 0 microversion: 2.1 time: 0.028010 Aug 30 04:38:11.936508 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 574/1173] 10.222.0.85 () {58 vars in 1221 bytes} [Tue Aug 30 04:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150974187 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:13.222709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-1573299d-2c22-4655-8e39-fcbba7ab91a4 req-8f2e97a2-f49c-46de-889c-6a8c52654a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8913aeda-b661-4c59-b19b-eb3252bf1047", "tag": "62ae85bd-5cc8-48f9-bbc5-06af77beba2a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:13.232936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1573299d-2c22-4655-8e39-fcbba7ab91a4 req-8f2e97a2-f49c-46de-889c-6a8c52654a08 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.233444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1573299d-2c22-4655-8e39-fcbba7ab91a4 req-8f2e97a2-f49c-46de-889c-6a8c52654a08 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.233896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1573299d-2c22-4655-8e39-fcbba7ab91a4 req-8f2e97a2-f49c-46de-889c-6a8c52654a08 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.247226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:13.247226 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-1573299d-2c22-4655-8e39-fcbba7ab91a4 req-8f2e97a2-f49c-46de-889c-6a8c52654a08 service nova] Creating event network-changed:62ae85bd-5cc8-48f9-bbc5-06af77beba2a for instance 8913aeda-b661-4c59-b19b-eb3252bf1047 on hv-cinder-85426 Aug 30 04:38:13.252664 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-1573299d-2c22-4655-8e39-fcbba7ab91a4 req-8f2e97a2-f49c-46de-889c-6a8c52654a08 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033395 Aug 30 04:38:13.253377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 600/1174] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:13.253580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.254254 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.261533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.262553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.262980 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.263660 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.264101 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.264513 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.349216 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lazy-loading 'services' on Instance uuid 6c85f91a-65a8-4467-a74e-e2101053764f {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:38:13.441963 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a35f9c99-43f6-4db3-983f-b82c8e8ea042 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments/f814553c-2fd0-4f9a-927f-3fde08742028" status: 202 len: 0 microversion: 2.1 time: 0.192026 Aug 30 04:38:13.442838 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 575/1175] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:38:13 2022] DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments/f814553c-2fd0-4f9a-927f-3fde08742028 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:38:13.452954 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.455604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.462292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.462900 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.463473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.464286 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.464949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.465492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.499453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5167508a-7d99-4548-8c3e-38880aefa52c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051740 Aug 30 04:38:13.500090 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 601/1176] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:14.513611 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.516164 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.523387 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.523868 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.524334 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.525024 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.525499 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.525916 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.557563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-658f4f0a-7598-441b-8527-81aea70d6de0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049065 Aug 30 04:38:14.559569 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 576/1177] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:14 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:38:14.621957 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.622493 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.628804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.629321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.629751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.630427 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.630871 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.631287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.657500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:14.731429 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52f24655-3fa6-4008-bf1a-97f60f6b3827 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 204 len: 0 microversion: 2.1 time: 0.113145 Aug 30 04:38:14.732268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 602/1178] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:14 2022] DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:14.741088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.741710 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.748312 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.748795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.749276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.749962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.750414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.750836 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.880132 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:14.888488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ffd428a5-9d32-4e5b-b92c-904871f00809 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1682 microversion: 2.1 time: 0.151675 Aug 30 04:38:14.889071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 577/1179] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:14 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:15.910169 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:15.910869 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:15.917246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.917726 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.918154 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.918864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.919312 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.919731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.047288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:16.054913 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f2ef0f99-b0c7-4900-b6c3-a1009a5f83bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1682 microversion: 2.1 time: 0.149026 Aug 30 04:38:16.055478 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 603/1180] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:15 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:17.074967 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.075579 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.082033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.082507 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.082935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.083614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.084059 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.084474 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.210803 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:17.219481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7832caed-c949-4a49-a8d0-d80551c41c5c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1682 microversion: 2.1 time: 0.148399 Aug 30 04:38:17.220108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 578/1181] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:18.035102 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-0c977b47-44cf-4149-95f9-c97d04edcaeb req-113e4ad1-3801-4c4a-9bb2-0358cc4168c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c85f91a-65a8-4467-a74e-e2101053764f", "name": "network-vif-deleted", "tag": "76600936-3d50-49e5-9256-9cf624893de2"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:18.044173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:18.050804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0c977b47-44cf-4149-95f9-c97d04edcaeb req-113e4ad1-3801-4c4a-9bb2-0358cc4168c4 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.051362 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0c977b47-44cf-4149-95f9-c97d04edcaeb req-113e4ad1-3801-4c4a-9bb2-0358cc4168c4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.051796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0c977b47-44cf-4149-95f9-c97d04edcaeb req-113e4ad1-3801-4c4a-9bb2-0358cc4168c4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.065741 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-0c977b47-44cf-4149-95f9-c97d04edcaeb req-113e4ad1-3801-4c4a-9bb2-0358cc4168c4 service nova] Creating event network-vif-deleted:76600936-3d50-49e5-9256-9cf624893de2 for instance 6c85f91a-65a8-4467-a74e-e2101053764f on hv-cinder-85426 Aug 30 04:38:18.072027 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-0c977b47-44cf-4149-95f9-c97d04edcaeb req-113e4ad1-3801-4c4a-9bb2-0358cc4168c4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040194 Aug 30 04:38:18.073049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 604/1182] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:18.242310 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:18.243612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:18.250737 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:18.252809 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.253535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.253976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.254687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.255302 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.255894 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.294153 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.294638 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.295072 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.295551 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lazy-loading 'fault' on Instance uuid 6c85f91a-65a8-4467-a74e-e2101053764f {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:38:18.338107 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:18.346111 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-557a5250-00bd-4980-b846-b06a34c2b4ad tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 200 len: 1331 microversion: 2.1 time: 0.108452 Aug 30 04:38:18.346873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 579/1183] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:18 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:19.368652 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:19.369288 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:19.376314 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.376792 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.377256 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.377934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.378376 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.378789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.392511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f HTTP/1.1 Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:38:19.394170 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:38:19.395767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '6c85f91a-65a8-4467-a74e-e2101053764f'} Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:19.396679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:38:19.398237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:38:19.399661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:19.399661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-25a9b6cd-8d97-4c66-bfbe-a76a202d800a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 30 04:38:19.399661 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 605/1184] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:19 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:19.404409 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aa095dcf-d17e-469d-ab99-0fa86dabf58b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '.version_select at 0x7fcda3da1670>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:19.422652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa095dcf-d17e-469d-ab99-0fa86dabf58b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-417962306" status: 202 len: 0 microversion: 2.1 time: 0.022013 Aug 30 04:38:19.423202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 580/1185] 10.222.0.85 () {58 vars in 1218 bytes} [Tue Aug 30 04:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-417962306 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:20.046126 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-56e21a80-95d1-4ffb-a489-d272e6cd3037 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: .version_select at 0x7fcda3fa2d30>, body: {"keypair": {"name": "tempest-keypair-388499758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAiJtx05l73lz8c0s5XylGYJT87kiOsq1LO6a9t2eRPIZVctimRAbKEukvfrccm/9Wg+jl9WovnvcHhbCHOy+D1Gx0bmmwWZU3gIqco1DVTr1TkIy2qCX0VkBDu7MVAWQ=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:20.061471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-56e21a80-95d1-4ffb-a489-d272e6cd3037 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:20.065354 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-56e21a80-95d1-4ffb-a489-d272e6cd3037 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:20.077323 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56e21a80-95d1-4ffb-a489-d272e6cd3037 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [9f092181-c7cb-4b9f-8c3e-0506b23f7999] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:38:21.084720 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO oslo.messaging._drivers.impl_rabbit [None req-56e21a80-95d1-4ffb-a489-d272e6cd3037 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [9f092181-c7cb-4b9f-8c3e-0506b23f7999] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 50412. Aug 30 04:38:21.100748 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-56e21a80-95d1-4ffb-a489-d272e6cd3037 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.059056 Aug 30 04:38:21.101381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 606/1186] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:38:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:22.324435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-395582383", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "028ab36d-9030-4e40-a42e-859885874e3a"}], "security_groups": [{"name": "tempest-securitygroup--1955607264"}], "key_name": "tempest-keypair-388499758", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:22.428396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] validate_networks() for [('028ab36d-9030-4e40-a42e-859885874e3a', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:38:22.789472 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:22.789888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:22.790351 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:22.790785 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:22.791187 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:22.799975 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.800503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.800929 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.801673 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.802114 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.802532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.818624 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:22.822497 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:22.833495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:22.835726 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:22.883264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b5dc8e16-fb50-4b8a-985a-227ca0a2c74b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563766 Aug 30 04:38:22.883905 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 581/1187] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:38:22.895781 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b736162-3490-47dc-9b29-461b1d7e6cce tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:22.896398 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0b736162-3490-47dc-9b29-461b1d7e6cce tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:22.951199 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b736162-3490-47dc-9b29-461b1d7e6cce tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:22.958377 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0b736162-3490-47dc-9b29-461b1d7e6cce tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1240 microversion: 2.1 time: 0.067074 Aug 30 04:38:22.959373 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 607/1188] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:22 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:23.980032 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:23.980631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:23.988241 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.988717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.989180 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.989854 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.990295 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.990720 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.054654 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:24.062341 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bffee494-b6bd-4511-8a11-52ee8a2ddbc1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1292 microversion: 2.1 time: 0.086699 Aug 30 04:38:24.062923 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 582/1189] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:23 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:25.083618 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:25.084315 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:25.091114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.091607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.092047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.092879 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.093555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.094650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.253805 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:25.261555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-de1ee470-63d6-458d-8bc3-850dd86e995f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.181734 Aug 30 04:38:25.262069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 608/1190] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:25 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:25.660139 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-39426348-1085-4c78-943f-fb8b5de457a1 req-480a8bc9-8ded-4a71-9300-847dbe05a6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc79d02-27f4-4b72-a772-c8e01ee2d41b", "tag": "eb5a3141-1165-4c27-ac96-859af1b6a702"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:25.670795 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-39426348-1085-4c78-943f-fb8b5de457a1 req-480a8bc9-8ded-4a71-9300-847dbe05a6e5 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.672811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-39426348-1085-4c78-943f-fb8b5de457a1 req-480a8bc9-8ded-4a71-9300-847dbe05a6e5 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.673280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-39426348-1085-4c78-943f-fb8b5de457a1 req-480a8bc9-8ded-4a71-9300-847dbe05a6e5 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.685293 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-39426348-1085-4c78-943f-fb8b5de457a1 req-480a8bc9-8ded-4a71-9300-847dbe05a6e5 service nova] Creating event network-changed:eb5a3141-1165-4c27-ac96-859af1b6a702 for instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b on hv-cinder-85426 Aug 30 04:38:25.690413 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-39426348-1085-4c78-943f-fb8b5de457a1 req-480a8bc9-8ded-4a71-9300-847dbe05a6e5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034017 Aug 30 04:38:25.691000 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 583/1191] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:26.281790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:26.282321 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:26.288649 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:26.289165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:26.289591 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:26.290265 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:26.290708 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:26.291120 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:26.418368 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:26.426615 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d31737b3-9719-42e8-9d4b-6f1c44714ff8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.148778 Aug 30 04:38:26.427198 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 609/1192] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:26 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:27.448594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:27.449327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:27.456366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:27.456852 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:27.457313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.458006 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:27.458457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:27.458878 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.591857 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:27.599622 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e5e64efd-7479-4aef-9604-b7d0902a07a5 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.155770 Aug 30 04:38:27.612784 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 584/1193] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:27 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:28.619819 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:28.620436 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:28.626945 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:28.627430 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:28.627902 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:28.628587 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:28.629058 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:28.629479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:28.758258 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:28.766391 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e795ce81-49e8-42b5-bda6-83b5bc54ccfb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.150501 Aug 30 04:38:28.766964 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 610/1194] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:28 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:29.787232 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:29.787834 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:29.794322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:29.794803 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:29.795247 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:29.796601 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:29.797067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:29.797488 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:29.924642 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:29.932274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4ce63bcd-d3fb-4eae-b8c2-e8ba58577a64 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.148962 Aug 30 04:38:29.932860 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 585/1195] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:29 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:30.413342 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a10d87aa-0cf6-4d23-aa52-240cdf3d6850 req-6dffa492-721f-44db-b86e-bb0c8a441ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc79d02-27f4-4b72-a772-c8e01ee2d41b", "name": "network-vif-plugged", "status": "completed", "tag": "eb5a3141-1165-4c27-ac96-859af1b6a702"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:30.425694 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a10d87aa-0cf6-4d23-aa52-240cdf3d6850 req-6dffa492-721f-44db-b86e-bb0c8a441ac2 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:30.426178 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a10d87aa-0cf6-4d23-aa52-240cdf3d6850 req-6dffa492-721f-44db-b86e-bb0c8a441ac2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:30.426609 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a10d87aa-0cf6-4d23-aa52-240cdf3d6850 req-6dffa492-721f-44db-b86e-bb0c8a441ac2 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:30.438306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a10d87aa-0cf6-4d23-aa52-240cdf3d6850 req-6dffa492-721f-44db-b86e-bb0c8a441ac2 service nova] Creating event network-vif-plugged:eb5a3141-1165-4c27-ac96-859af1b6a702 for instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b on hv-cinder-85426 Aug 30 04:38:30.443329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a10d87aa-0cf6-4d23-aa52-240cdf3d6850 req-6dffa492-721f-44db-b86e-bb0c8a441ac2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034132 Aug 30 04:38:30.444319 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 611/1196] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:30.951716 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:30.952354 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:30.958805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:30.959276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:30.959700 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:30.960374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:30.960814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:30.961269 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:31.090473 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:31.098089 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-04a1b5ef-f43c-4665-a67b-1888d28864ca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.150256 Aug 30 04:38:31.098659 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 586/1197] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:30 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:32.119944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:32.120641 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:32.127771 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:32.128250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:32.128679 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:32.129394 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:32.129836 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:32.130253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:32.255861 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:32.263380 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eae35415-5190-4c0f-bd10-2cb8c7ab43bd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1366 microversion: 2.1 time: 0.147718 Aug 30 04:38:32.263981 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 612/1198] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:32 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:33.285859 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:33.286392 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:33.288856 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:33.289573 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:33.296016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.296489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.296911 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.297612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.298054 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.298469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.428523 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:33.437198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-51cb0c65-baee-4a85-9b63-eca1491cb4b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1557 microversion: 2.1 time: 0.155385 Aug 30 04:38:33.437764 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 587/1199] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:33 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:33.457892 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:33.458392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:33.460357 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:33.466450 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.466938 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.467372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.468061 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.468513 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.468934 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.544669 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6911ad96-e062-4dc9-88dd-1c9365711f0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090652 Aug 30 04:38:33.545304 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 613/1200] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:38:33 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:34.452751 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-d3bcc1d4-8a97-4ce2-bc8a-1defde537762 req-04703c1d-076e-4b1a-bb1b-0665e89b98f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc79d02-27f4-4b72-a772-c8e01ee2d41b", "tag": "eb5a3141-1165-4c27-ac96-859af1b6a702"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:34.462510 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d3bcc1d4-8a97-4ce2-bc8a-1defde537762 req-04703c1d-076e-4b1a-bb1b-0665e89b98f4 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.462984 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d3bcc1d4-8a97-4ce2-bc8a-1defde537762 req-04703c1d-076e-4b1a-bb1b-0665e89b98f4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.463414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d3bcc1d4-8a97-4ce2-bc8a-1defde537762 req-04703c1d-076e-4b1a-bb1b-0665e89b98f4 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.477256 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-d3bcc1d4-8a97-4ce2-bc8a-1defde537762 req-04703c1d-076e-4b1a-bb1b-0665e89b98f4 service nova] Creating event network-changed:eb5a3141-1165-4c27-ac96-859af1b6a702 for instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b on hv-cinder-85426 Aug 30 04:38:34.482563 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-d3bcc1d4-8a97-4ce2-bc8a-1defde537762 req-04703c1d-076e-4b1a-bb1b-0665e89b98f4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Aug 30 04:38:34.484297 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 588/1201] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:13.298109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:13.298942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:13.303155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:13.303647 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:13.311356 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:13.311829 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:13.312325 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:13.313022 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:13.313496 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:13.313921 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:13.338607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cbacd163-34b0-486b-8941-f5cfdc49cf0f tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/ips" status: 200 len: 151 microversion: 2.1 time: 0.043404 Aug 30 04:39:13.339172 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 614/1202] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:39:13 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:14.664369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:14.665185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:14.670220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c670a38d-e057-49f9-ae8f-b72d9881603f"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:14.672603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:14.682214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.682697 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.683133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.683818 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.684268 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.684790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.981480 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bc59009e-715d-427f-b4f3-5240f700563c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319066 Aug 30 04:39:14.982262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 589/1203] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:39:14 2022] POST /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:22.506301 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c670a38d-e057-49f9-ae8f-b72d9881603f"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:22.508654 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:22.515118 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.515595 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.516026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.516710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.517190 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.517611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.595166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Invalid volume: volume c670a38d-e057-49f9-ae8f-b72d9881603f is already attached to instances: bbc79d02-27f4-4b72-a772-c8e01ee2d41b Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: POST /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments HTTP/1.1 Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 74 Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:39:22.596868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {"volumeAttachment": {"volumeId": "c670a38d-e057-49f9-ae8f-b72d9881603f"}} Aug 30 04:39:22.598387 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Invalid volume: volume c670a38d-e057-49f9-ae8f-b72d9881603f is already attached to instances: bbc79d02-27f4-4b72-a772-c8e01ee2d41b Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'server_id': 'bbc79d02-27f4-4b72-a772-c8e01ee2d41b', 'body': {'volumeAttachment': {'volumeId': 'c670a38d-e057-49f9-ae8f-b72d9881603f'}}} Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c670a38d-e057-49f9-ae8f-b72d9881603f is already attached to instances: bbc79d02-27f4-4b72-a772-c8e01ee2d41b Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:22.599205 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c670a38d-e057-49f9-ae8f-b72d9881603f is already attached to instances: bbc79d02-27f4-4b72-a772-c8e01ee2d41b Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:22.600671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c670a38d-e057-49f9-ae8f-b72d9881603f is already attached to instances: bbc79d02-27f4-4b72-a772-c8e01ee2d41b Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 400 to user: Invalid volume: volume c670a38d-e057-49f9-ae8f-b72d9881603f is already attached to instances: bbc79d02-27f4-4b72-a772-c8e01ee2d41b {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c51f3b96-8c26-4f13-ac67-c9ab5c6e77dd tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096244 Aug 30 04:39:22.602206 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 615/1204] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:39:22 2022] POST /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:39:22.665560 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:22.666138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:22.672333 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.672812 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.673278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.673962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.674408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.674824 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.753076 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lazy-loading 'services' on Instance uuid bbc79d02-27f4-4b72-a772-c8e01ee2d41b {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:39:22.824143 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e0906738-8ecc-4d64-9cd1-a559a467fc9e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments/c670a38d-e057-49f9-ae8f-b72d9881603f" status: 202 len: 0 microversion: 2.1 time: 0.163278 Aug 30 04:39:22.824730 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 590/1205] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:39:22 2022] DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments/c670a38d-e057-49f9-ae8f-b72d9881603f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:22.834520 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:22.836748 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:22.848084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.848588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.849049 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.849763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.850219 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.850650 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.883101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-17f2917c-6493-48ee-ac8f-aec84e91ac9a tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053224 Aug 30 04:39:22.883582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 616/1206] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:39:22 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:23.896397 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:23.898760 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:23.904943 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:23.905458 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:23.905893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:23.906580 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:23.907031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:23.907453 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:23.936680 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f240cfa0-13e0-492a-9cb2-2aba2240540c tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044515 Aug 30 04:39:23.937252 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 591/1207] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:39:23 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:39:23.998967 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:23.999530 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:24.006145 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:24.006922 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:24.007497 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.008508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:24.009162 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:24.009685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.035261 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:24.113754 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-41939118-c304-4ae3-a116-eaa10e3bac21 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 204 len: 0 microversion: 2.1 time: 0.119822 Aug 30 04:39:24.114402 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 617/1208] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:23 2022] DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:24.123029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:24.124457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:24.130495 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:24.130976 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:24.131403 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.132093 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:24.132544 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:24.132960 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.260498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:24.268313 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f0da88c8-3d1a-4a72-945f-3a55a85b3573 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1682 microversion: 2.1 time: 0.149182 Aug 30 04:39:24.268877 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 592/1209] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:24 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:25.290363 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:25.291069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:25.297566 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:25.298043 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:25.298500 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:25.299189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:25.299636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:25.300053 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:25.429956 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:25.438189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b2bb50ce-a758-41bc-8a60-b00fffff1b5d tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1682 microversion: 2.1 time: 0.152062 Aug 30 04:39:25.438751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 618/1210] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:25 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:26.459825 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:26.460444 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:26.466994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:26.468029 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:26.468459 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:26.469184 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:26.469625 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:26.470046 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:26.603687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:26.612120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2bcfc0e8-66e6-4c06-adae-ed9f4b48b4e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1682 microversion: 2.1 time: 0.156241 Aug 30 04:39:26.612686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 593/1211] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:26 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:27.029992 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-2518cb77-6dcc-476e-9844-1247df9be174 req-69f35772-2068-4988-a14a-b1b3d1bb1139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc79d02-27f4-4b72-a772-c8e01ee2d41b", "name": "network-vif-deleted", "tag": "eb5a3141-1165-4c27-ac96-859af1b6a702"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:27.041584 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2518cb77-6dcc-476e-9844-1247df9be174 req-69f35772-2068-4988-a14a-b1b3d1bb1139 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.042063 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2518cb77-6dcc-476e-9844-1247df9be174 req-69f35772-2068-4988-a14a-b1b3d1bb1139 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.042492 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2518cb77-6dcc-476e-9844-1247df9be174 req-69f35772-2068-4988-a14a-b1b3d1bb1139 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.056009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-2518cb77-6dcc-476e-9844-1247df9be174 req-69f35772-2068-4988-a14a-b1b3d1bb1139 service nova] Creating event network-vif-deleted:eb5a3141-1165-4c27-ac96-859af1b6a702 for instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b on hv-cinder-85426 Aug 30 04:39:27.062671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-2518cb77-6dcc-476e-9844-1247df9be174 req-69f35772-2068-4988-a14a-b1b3d1bb1139 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035665 Aug 30 04:39:27.063317 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 619/1212] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:27.635323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:27.635927 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:27.642156 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.642641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.643071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.643768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.644214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.644631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.681308 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.681801 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.682238 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.682688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lazy-loading 'fault' on Instance uuid bbc79d02-27f4-4b72-a772-c8e01ee2d41b {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:39:27.724744 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:27.733816 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7c19fc2f-6267-44e2-a246-21dacc0724b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 200 len: 1330 microversion: 2.1 time: 0.102507 Aug 30 04:39:27.734652 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 594/1213] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:27 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:28.755094 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:28.755800 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:28.762473 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:28.762958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:28.763395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:28.764108 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:28.764557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:28.764983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:28.778339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b HTTP/1.1 Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:39:28.780033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:39:28.781763 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'bbc79d02-27f4-4b72-a772-c8e01ee2d41b'} Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:28.782832 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:39:28.784415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:39:28.786290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:28.786290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8c02f77b-3171-46d1-b0a9-ec16aeb08ac2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 404 len: 111 microversion: 2.1 time: 0.030585 Aug 30 04:39:28.786290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 620/1214] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:28 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:28.790350 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f5a9fa36-e07e-430e-aa2d-702cfde60fd2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '.version_select at 0x7fcda3d44af0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:28.811540 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f5a9fa36-e07e-430e-aa2d-702cfde60fd2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388499758" status: 202 len: 0 microversion: 2.1 time: 0.024369 Aug 30 04:39:28.812353 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 595/1215] 10.222.0.85 () {58 vars in 1218 bytes} [Tue Aug 30 04:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388499758 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:29.663355 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f847bf62-80e2-42e1-9af1-d3afa9de7c6e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: .version_select at 0x7fcda3fca670>, body: {"keypair": {"name": "tempest-keypair-1698183578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlL4iQPJi6jnHt6DC7KXAS9gqf/KF4kxyCWBMoXAa13FLrSq1HxrmE7UA2NOcY7okrSvSoBBW9enIgoEw5b7q+AWXbiq/ENCSA2JVd9Q7P/6vnSoiE40AZu42HyRLV/Ug=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:29.678696 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f847bf62-80e2-42e1-9af1-d3afa9de7c6e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:29.682786 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f847bf62-80e2-42e1-9af1-d3afa9de7c6e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:29.707166 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f847bf62-80e2-42e1-9af1-d3afa9de7c6e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047745 Aug 30 04:39:29.707769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 621/1216] 10.222.0.85 () {60 vars in 1159 bytes} [Tue Aug 30 04:39:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:30.948391 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-346859932", "imageRef": "17bcba2b-53dd-47b1-989b-68a69fdaef17", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "028ab36d-9030-4e40-a42e-859885874e3a"}], "security_groups": [{"name": "tempest-securitygroup--349233674"}], "key_name": "tempest-keypair-1698183578", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:31.056617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] validate_networks() for [('028ab36d-9030-4e40-a42e-859885874e3a', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:39:31.447861 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:39:31.448273 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:39:31.448738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:39:31.449168 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:39:31.449572 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:39:31.458993 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.459465 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.459893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.460613 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.461077 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.461502 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.478030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:31.482244 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Getting quotas for user 8df68cb66f6d4369bba0eda189b8e64d and project c561fdf35e454833b521f54043c49035. Resources: {'cores', 'ram', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:31.493645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:39:31.495939 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bcba2b-53dd-47b1-989b-68a69fdaef17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:39:31.543280 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c0a09d42-4fb9-4561-9d9c-71429485ac4e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599194 Aug 30 04:39:31.543924 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 596/1217] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:39:31.555382 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-50bc82a3-224b-4fd8-919c-9f2b34e46871 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:31.556124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-50bc82a3-224b-4fd8-919c-9f2b34e46871 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:31.613982 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50bc82a3-224b-4fd8-919c-9f2b34e46871 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:31.620842 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-50bc82a3-224b-4fd8-919c-9f2b34e46871 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1241 microversion: 2.1 time: 0.069482 Aug 30 04:39:31.621453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 622/1218] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:31 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:32.642536 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:32.643102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:32.650109 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:32.650593 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:32.651033 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.651730 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:32.652182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:32.652598 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.723810 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:32.731718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dd562a33-1a8c-472b-8abb-ffd555a3d2b9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1293 microversion: 2.1 time: 0.093591 Aug 30 04:39:32.732553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 597/1219] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:32 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:33.754124 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:33.755327 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:33.761878 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.762363 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.762790 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.763489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.764001 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.764424 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.900636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:33.908971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-44f34bf8-e296-4f2c-826e-b3ca2d0c7504 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.158722 Aug 30 04:39:33.909578 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 623/1220] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:33 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:34.259992 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-be97b49d-2d31-400e-9348-7d99367a9ae9 req-221ce193-66b7-4b33-b100-112ef7677232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc06bf35-72bb-4c33-b3b5-d4414c98606b", "tag": "0078d856-a94b-4071-a2ec-79c808646db3"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:34.270100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-be97b49d-2d31-400e-9348-7d99367a9ae9 req-221ce193-66b7-4b33-b100-112ef7677232 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.270735 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-be97b49d-2d31-400e-9348-7d99367a9ae9 req-221ce193-66b7-4b33-b100-112ef7677232 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.271171 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-be97b49d-2d31-400e-9348-7d99367a9ae9 req-221ce193-66b7-4b33-b100-112ef7677232 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.285888 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-be97b49d-2d31-400e-9348-7d99367a9ae9 req-221ce193-66b7-4b33-b100-112ef7677232 service nova] Creating event network-changed:0078d856-a94b-4071-a2ec-79c808646db3 for instance cc06bf35-72bb-4c33-b3b5-d4414c98606b on hv-cinder-85426 Aug 30 04:39:34.291066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-be97b49d-2d31-400e-9348-7d99367a9ae9 req-221ce193-66b7-4b33-b100-112ef7677232 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034966 Aug 30 04:39:34.292016 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 598/1221] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:34.930595 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:34.931230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:34.938284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.938751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.939184 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.939874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.940318 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.940738 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:35.074033 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:35.082742 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c2e1a60-77a1-4066-87ec-3cbf75fec992 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.155999 Aug 30 04:39:35.083320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 624/1222] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:34 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:36.103306 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:36.104007 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:36.110948 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.111435 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.111867 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.112611 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.113004 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.113448 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.242722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:36.250355 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e7e3effd-1f29-41b2-b8d0-f3fdf105f110 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.151314 Aug 30 04:39:36.250919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 599/1223] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:36 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:37.270953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:37.271590 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:37.278089 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.278674 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.279052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.281944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.281944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.281944 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.415910 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:37.424526 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-47ac4930-d543-4c92-a3c4-f2f4ca39848e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.157423 Aug 30 04:39:37.425173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 625/1224] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:37 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:38.445492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:38.446097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:38.453376 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.453864 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.454296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.455027 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.455470 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.455886 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.591336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:38.599643 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-837db896-24ee-4e89-b7d4-30473d303c06 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.158062 Aug 30 04:39:38.600207 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 600/1225] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:38 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:38.792924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-97bd213f-ef8e-482b-a017-bee13f4e9440 req-9f3d86a4-70bc-48b0-a11a-531a533a9f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc06bf35-72bb-4c33-b3b5-d4414c98606b", "name": "network-vif-plugged", "status": "completed", "tag": "0078d856-a94b-4071-a2ec-79c808646db3"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:38.803369 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-97bd213f-ef8e-482b-a017-bee13f4e9440 req-9f3d86a4-70bc-48b0-a11a-531a533a9f59 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.803849 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-97bd213f-ef8e-482b-a017-bee13f4e9440 req-9f3d86a4-70bc-48b0-a11a-531a533a9f59 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.804363 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-97bd213f-ef8e-482b-a017-bee13f4e9440 req-9f3d86a4-70bc-48b0-a11a-531a533a9f59 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.815474 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-97bd213f-ef8e-482b-a017-bee13f4e9440 req-9f3d86a4-70bc-48b0-a11a-531a533a9f59 service nova] Creating event network-vif-plugged:0078d856-a94b-4071-a2ec-79c808646db3 for instance cc06bf35-72bb-4c33-b3b5-d4414c98606b on hv-cinder-85426 Aug 30 04:39:38.820475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-97bd213f-ef8e-482b-a017-bee13f4e9440 req-9f3d86a4-70bc-48b0-a11a-531a533a9f59 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Aug 30 04:39:38.821272 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 626/1226] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:39.619696 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:39.620296 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:39.626722 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:39.627189 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:39.627606 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:39.628276 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:39.628714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:39.629155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:39.757081 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:39.765589 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-26de99f8-e337-4421-97d7-8f3505b22194 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.149789 Aug 30 04:39:39.766182 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 601/1227] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:39 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:40.786780 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:40.787386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:40.793787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.794275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.794712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.795970 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.796425 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.796846 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.931177 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:40.939069 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-39819cac-7cdc-4273-a62d-168a6fe13c83 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1366 microversion: 2.1 time: 0.157088 Aug 30 04:39:40.939645 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 627/1228] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:40 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:41.960476 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:41.961148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:41.963578 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:41.964246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:41.970213 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.970693 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.971123 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.971813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.972262 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.972681 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.105657 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:42.114152 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d22728ff-7f37-4fbe-a819-c3f3f28699b1 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1556 microversion: 2.1 time: 0.157573 Aug 30 04:39:42.114725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 602/1229] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:41 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:42.136971 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:42.137536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:42.139629 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:42.145489 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.146024 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.146485 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.147211 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.147673 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.148110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.225341 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3a0df2a3-9e37-42d0-8239-c319491df9a4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092389 Aug 30 04:39:42.225969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 628/1230] 10.222.0.85 () {58 vars in 1275 bytes} [Tue Aug 30 04:39:42 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:43.408306 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-15b2e1e9-b31d-4499-b416-4dedcba50f58 req-7474514c-808d-4a51-9f9b-50617a1142e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc06bf35-72bb-4c33-b3b5-d4414c98606b", "tag": "0078d856-a94b-4071-a2ec-79c808646db3"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:43.418913 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-15b2e1e9-b31d-4499-b416-4dedcba50f58 req-7474514c-808d-4a51-9f9b-50617a1142e8 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:43.419506 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-15b2e1e9-b31d-4499-b416-4dedcba50f58 req-7474514c-808d-4a51-9f9b-50617a1142e8 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:43.420030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-15b2e1e9-b31d-4499-b416-4dedcba50f58 req-7474514c-808d-4a51-9f9b-50617a1142e8 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:43.431637 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-15b2e1e9-b31d-4499-b416-4dedcba50f58 req-7474514c-808d-4a51-9f9b-50617a1142e8 service nova] Creating event network-changed:0078d856-a94b-4071-a2ec-79c808646db3 for instance cc06bf35-72bb-4c33-b3b5-d4414c98606b on hv-cinder-85426 Aug 30 04:39:43.437806 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-15b2e1e9-b31d-4499-b416-4dedcba50f58 req-7474514c-808d-4a51-9f9b-50617a1142e8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033258 Aug 30 04:39:43.438728 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 603/1231] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:05.854864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:05.855671 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:05.860064 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2127615181", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-754690315", "security_groups": [{"name": "tempest-secgroup-smoke-1522422868"}], "block_device_mapping_v2": [{"uuid": "88294e1c-2ca6-468b-8299-ca1c73c70c6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bb2295-ab1f-4755-bab5-38bb2e0a7b79"}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:05.976232 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] validate_networks() for [('05bb2295-ab1f-4755-bab5-38bb2e0a7b79', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:40:06.403224 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:40:06.403659 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:40:06.404155 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:40:06.404589 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:40:06.405026 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:40:06.414396 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.414877 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.415311 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.416032 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.416488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.416940 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.433475 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for project 18e4bf7297124da4b43ccaeda048f772. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:40:06.437406 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Getting quotas for user 2625939a0b9a43d59452df9ba9982ecb and project 18e4bf7297124da4b43ccaeda048f772. Resources: {'cores', 'ram', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:40:06.497841 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:40:06.499943 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88294e1c-2ca6-468b-8299-ca1c73c70c6f',volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:40:06.629508 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [e2aaa51d-70ef-4544-9328-fc52549083ef] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:40:07.638444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO oslo.messaging._drivers.impl_rabbit [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [e2aaa51d-70ef-4544-9328-fc52549083ef] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 50694. Aug 30 04:40:07.642292 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-13099daf-2a15-4667-bd64-daf5e5f895d7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.788831 Aug 30 04:40:07.642947 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 629/1232] 10.222.0.85 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:40:07.652739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:07.654374 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:07.658817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a6cc67b6-7e29-47bc-a4f9-d5e247714de9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:07.659655 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a6cc67b6-7e29-47bc-a4f9-d5e247714de9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:07.729146 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a6cc67b6-7e29-47bc-a4f9-d5e247714de9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:07.736492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a6cc67b6-7e29-47bc-a4f9-d5e247714de9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1094 microversion: 2.1 time: 0.085740 Aug 30 04:40:07.737116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 604/1233] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:07 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:08.757931 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:08.758570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:08.764642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.765149 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.765582 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.766268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.766712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.767135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.829822 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:08.837996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ff3ede6f-2fd0-42ba-a385-11d33fc35957 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1192 microversion: 2.1 time: 0.084935 Aug 30 04:40:08.838577 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 630/1234] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:08 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:09.859108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:09.859731 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:09.867414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:09.868167 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:09.868791 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:09.869609 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:09.870116 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:09.870461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.032617 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:10.040729 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f010d182-8616-4e14-993f-70d25953ef3f tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1278 microversion: 2.1 time: 0.185821 Aug 30 04:40:10.041668 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 605/1235] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:09 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:10.505399 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a09ea204-8a85-45bd-adbe-f5c2db6347ed req-397f4e19-8f2d-4df8-bd45-01c85c5f34e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225eb902-89f6-40a7-a7ab-6920239fea06", "tag": "2bbc9929-169f-4688-9954-202d82d50d7f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:10.516833 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a09ea204-8a85-45bd-adbe-f5c2db6347ed req-397f4e19-8f2d-4df8-bd45-01c85c5f34e0 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.517361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a09ea204-8a85-45bd-adbe-f5c2db6347ed req-397f4e19-8f2d-4df8-bd45-01c85c5f34e0 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.517888 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a09ea204-8a85-45bd-adbe-f5c2db6347ed req-397f4e19-8f2d-4df8-bd45-01c85c5f34e0 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.530220 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a09ea204-8a85-45bd-adbe-f5c2db6347ed req-397f4e19-8f2d-4df8-bd45-01c85c5f34e0 service nova] Creating event network-changed:2bbc9929-169f-4688-9954-202d82d50d7f for instance 225eb902-89f6-40a7-a7ab-6920239fea06 on hv-cinder-85426 Aug 30 04:40:10.535194 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a09ea204-8a85-45bd-adbe-f5c2db6347ed req-397f4e19-8f2d-4df8-bd45-01c85c5f34e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034464 Aug 30 04:40:10.535784 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 631/1236] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:11.063786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:11.064317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:11.070720 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:11.071198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:11.071631 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:11.072317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:11.072765 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:11.073222 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:11.210362 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:11.218188 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bcc91a74-4b2e-471e-ab79-c1405873f677 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.158355 Aug 30 04:40:11.218761 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 606/1237] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:11 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:12.241448 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:12.242147 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:12.248510 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.248996 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.249453 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.250413 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.251072 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.251564 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.387400 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:12.395782 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5213149a-7ccb-42bb-a110-162c13c2da64 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.159606 Aug 30 04:40:12.396372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 632/1238] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:12 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:13.416790 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.417385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:13.423733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.424214 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.424641 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.425845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.426300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.426719 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.556408 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:13.564151 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-44a52fa7-f648-4e3c-8699-ae95f87993ad tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.151363 Aug 30 04:40:13.564714 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 607/1239] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:13 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:14.585815 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:14.586449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:14.593123 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.593604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.594035 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.594723 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.595180 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.595601 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.734631 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:14.742435 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9c4f2c51-456d-4756-b4fb-7a97f2bee484 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.161019 Aug 30 04:40:14.743007 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 633/1240] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:14 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:15.765811 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:15.766446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:15.773516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.773998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.774430 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.775119 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.775570 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.775994 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.906754 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:15.915147 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8a5b44df-8b6c-4bd0-b281-be9c32c8f663 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.153250 Aug 30 04:40:15.915712 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 608/1241] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:15 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:16.935675 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:16.936289 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:16.938765 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:16.939631 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:16.945073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.945556 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.945990 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.946683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.947135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.947554 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.078156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:17.086526 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-44a036e0-5d42-4a3a-9a41-c6b2f3be6520 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.154770 Aug 30 04:40:17.087095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 634/1242] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:16 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:18.108804 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:18.109457 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:18.112423 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:18.117821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.118323 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.118746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.119591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.120051 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.120479 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.260706 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:18.268626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d20ebbd9-ea0d-4cca-8e97-3690ee992ccd tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.163964 Aug 30 04:40:18.269224 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 609/1243] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:18 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:19.290634 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:19.291385 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:19.298084 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.298575 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.299011 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.299712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.300821 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.301281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.437297 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:19.445077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ccffc7c3-6a99-4b40-9de9-d69a355751ed tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.159237 Aug 30 04:40:19.445651 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 635/1244] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:19 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:20.465759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:20.466384 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:20.473600 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:20.474086 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:20.474541 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:20.475246 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:20.475702 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:20.476124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:20.611584 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:20.620088 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b9de3112-3ddb-4721-8d84-a6256a178b97 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.158170 Aug 30 04:40:20.620664 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 610/1245] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:20 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:21.070386 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-3fd68a1e-d98f-40bf-b2af-f28177c168a5 req-49cea51c-a314-427d-862d-9146309821dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225eb902-89f6-40a7-a7ab-6920239fea06", "name": "network-vif-plugged", "status": "completed", "tag": "2bbc9929-169f-4688-9954-202d82d50d7f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:21.080638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3fd68a1e-d98f-40bf-b2af-f28177c168a5 req-49cea51c-a314-427d-862d-9146309821dd service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.081183 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3fd68a1e-d98f-40bf-b2af-f28177c168a5 req-49cea51c-a314-427d-862d-9146309821dd service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.082110 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3fd68a1e-d98f-40bf-b2af-f28177c168a5 req-49cea51c-a314-427d-862d-9146309821dd service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.093716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-3fd68a1e-d98f-40bf-b2af-f28177c168a5 req-49cea51c-a314-427d-862d-9146309821dd service nova] Creating event network-vif-plugged:2bbc9929-169f-4688-9954-202d82d50d7f for instance 225eb902-89f6-40a7-a7ab-6920239fea06 on hv-cinder-85426 Aug 30 04:40:21.099361 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-3fd68a1e-d98f-40bf-b2af-f28177c168a5 req-49cea51c-a314-427d-862d-9146309821dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Aug 30 04:40:21.099951 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 636/1246] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:21.640492 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:21.641176 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.647794 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.648283 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.648717 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.649454 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.649903 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.650327 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.796340 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:21.804958 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d2314cc2-2edf-406e-98f2-2e3d353c3269 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.168420 Aug 30 04:40:21.806739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 611/1247] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:21 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:22.829075 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:22.829775 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:22.837129 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:22.837611 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:22.838041 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:22.838730 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:22.839174 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:22.839588 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:22.976642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:22.984751 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0a019b14-7964-4033-9dc1-22476da5166a tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1266 microversion: 2.1 time: 0.159885 Aug 30 04:40:22.985370 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 637/1248] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:22 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:24.005620 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:24.006395 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:24.012587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.013105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.013543 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.014239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.014687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.015108 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.154234 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:24.162926 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0b4b19e7-7876-42b9-b417-ebbee22ebc5b tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1453 microversion: 2.1 time: 0.161091 Aug 30 04:40:24.163510 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 612/1249] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:24 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:24.183728 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:24.184925 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:24.196633 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.197570 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.198372 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.199253 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.199949 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.200392 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.339507 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:24.347709 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bdae69b0-3923-4da4-bd34-d64c05749351 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1453 microversion: 2.1 time: 0.168816 Aug 30 04:40:24.348347 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 638/1250] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:24 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:25.970534 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-33938598-cddd-4a3d-936a-10b52a11d401 req-c058fef6-8f97-4ee2-83d8-944b62520359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225eb902-89f6-40a7-a7ab-6920239fea06", "tag": "2bbc9929-169f-4688-9954-202d82d50d7f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:25.981102 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-33938598-cddd-4a3d-936a-10b52a11d401 req-c058fef6-8f97-4ee2-83d8-944b62520359 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.982535 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-33938598-cddd-4a3d-936a-10b52a11d401 req-c058fef6-8f97-4ee2-83d8-944b62520359 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.982968 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-33938598-cddd-4a3d-936a-10b52a11d401 req-c058fef6-8f97-4ee2-83d8-944b62520359 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.994900 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-33938598-cddd-4a3d-936a-10b52a11d401 req-c058fef6-8f97-4ee2-83d8-944b62520359 service nova] Creating event network-changed:2bbc9929-169f-4688-9954-202d82d50d7f for instance 225eb902-89f6-40a7-a7ab-6920239fea06 on hv-cinder-85426 Aug 30 04:40:25.999975 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-33938598-cddd-4a3d-936a-10b52a11d401 req-c058fef6-8f97-4ee2-83d8-944b62520359 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033108 Aug 30 04:40:26.000872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 613/1251] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:40:27.213008 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:27.213628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:27.220116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.220638 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.221109 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.221874 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.222862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.223291 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.248804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1067f409-4fa3-409c-b995-613e14313a96 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/ips" status: 200 len: 148 microversion: 2.1 time: 0.039662 Aug 30 04:40:27.249444 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 639/1252] 10.222.0.85 () {58 vars in 1248 bytes} [Tue Aug 30 04:40:27 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:28.590037 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d08f09ae-b22a-4f37-8b0a-bb865221d4ac"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:28.592446 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:28.599233 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.599713 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.600145 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.601264 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.601709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.602120 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.902124 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8c73a3a1-556a-4672-8f2a-eeb05ec7eb0b tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "POST /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317183 Aug 30 04:40:28.902931 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 614/1253] 10.222.0.85 () {60 vars in 1323 bytes} [Tue Aug 30 04:40:28 2022] POST /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:36.539284 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:36.539865 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:36.542334 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:36.548716 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.549250 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.549693 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.550983 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.551437 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.551862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.555114 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=53 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:36.635505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lazy-loading 'services' on Instance uuid cc06bf35-72bb-4c33-b3b5-d4414c98606b {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:40:36.707533 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a1afb467-cef0-48fe-8977-9ab9ab6aff11 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments/d08f09ae-b22a-4f37-8b0a-bb865221d4ac" status: 202 len: 0 microversion: 2.1 time: 0.172118 Aug 30 04:40:36.708122 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 640/1254] 10.222.0.85 () {58 vars in 1416 bytes} [Tue Aug 30 04:40:36 2022] DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments/d08f09ae-b22a-4f37-8b0a-bb865221d4ac => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:36.717989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:36.720369 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:36.728441 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.729093 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.729567 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.730431 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.730947 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.732274 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.765612 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-41255bac-1db2-4d6f-8157-1960d51c86ba tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052732 Aug 30 04:40:36.766193 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 615/1255] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:40:36 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:37.779012 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:37.781306 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:37.788622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.789134 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.789574 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.790275 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.790731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.791156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.822247 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c049c395-422d-4034-bff6-44ab9b049401 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Aug 30 04:40:37.822831 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 641/1256] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:40:37 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:38.835075 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:38.837190 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.839805 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=27 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:38.845231 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.845745 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.846177 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.846872 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.847317 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.847739 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.850414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:38.881014 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c94ec363-7d9e-4383-a7b5-4772700e31e4 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050533 Aug 30 04:40:38.881603 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 616/1257] 10.222.0.85 () {58 vars in 1302 bytes} [Tue Aug 30 04:40:38 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:40:38.944504 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:38.945091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.951480 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.951965 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.952395 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.953115 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.953566 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.953987 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.979542 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:40:39.067695 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-369e1416-5acf-4baf-9418-f48739d074e9 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 204 len: 0 microversion: 2.1 time: 0.127326 Aug 30 04:40:39.068290 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 642/1258] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:38 2022] DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:40:39.081410 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:39.082475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:39.092315 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.093135 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.093882 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.095041 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.095808 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.096532 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.236898 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:39.245565 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-acf10992-e6c0-4b06-a364-aeae5d496eca tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1679 microversion: 2.1 time: 0.171163 Aug 30 04:40:39.246138 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 617/1259] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:39 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:40.267243 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:40.267969 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:40.274389 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.274882 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.275339 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.276025 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.276477 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.276903 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.407686 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:40.416037 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d7dabf8b-6f5b-4810-8d39-089cbc3242b7 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1679 microversion: 2.1 time: 0.153126 Aug 30 04:40:40.416604 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 643/1260] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:40 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:41.437049 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:41.437663 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:41.444771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.445298 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.445733 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.446628 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.447083 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.447503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.583621 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:41.592500 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-832c9006-11df-4ac3-b5f9-0e4e11bbac5e tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1679 microversion: 2.1 time: 0.159279 Aug 30 04:40:41.593106 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 618/1261] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:41 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:42.340555 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-77fbd5c5-f3c5-4063-aaa4-edc78ce1c9bc req-35fb4380-7f54-4eae-94b5-3588b093518c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc06bf35-72bb-4c33-b3b5-d4414c98606b", "name": "network-vif-deleted", "tag": "0078d856-a94b-4071-a2ec-79c808646db3"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:42.350953 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-77fbd5c5-f3c5-4063-aaa4-edc78ce1c9bc req-35fb4380-7f54-4eae-94b5-3588b093518c service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.351446 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-77fbd5c5-f3c5-4063-aaa4-edc78ce1c9bc req-35fb4380-7f54-4eae-94b5-3588b093518c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.351864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-77fbd5c5-f3c5-4063-aaa4-edc78ce1c9bc req-35fb4380-7f54-4eae-94b5-3588b093518c service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.363936 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-77fbd5c5-f3c5-4063-aaa4-edc78ce1c9bc req-35fb4380-7f54-4eae-94b5-3588b093518c service nova] Creating event network-vif-deleted:0078d856-a94b-4071-a2ec-79c808646db3 for instance cc06bf35-72bb-4c33-b3b5-d4414c98606b on hv-cinder-85426 Aug 30 04:40:42.369309 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-77fbd5c5-f3c5-4063-aaa4-edc78ce1c9bc req-35fb4380-7f54-4eae-94b5-3588b093518c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Aug 30 04:40:42.370324 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 644/1262] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:42.614893 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:42.615494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:42.622278 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.622786 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.623202 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.623895 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.624342 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.624759 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.660011 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.660489 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.661001 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.661494 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lazy-loading 'fault' on Instance uuid cc06bf35-72bb-4c33-b3b5-d4414c98606b {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:40:42.705067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df68cb66f6d4369bba0eda189b8e64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561fdf35e454833b521f54043c49035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:42.713148 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-15e07498-ca4c-4dde-8fef-cdad2e8a37cb tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 200 len: 1331 microversion: 2.1 time: 0.102731 Aug 30 04:40:42.713768 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 619/1263] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:42 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:43.735374 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:43.736077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:43.742221 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.742702 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.743136 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.743820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.744268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.744689 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.758207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b HTTP/1.1 Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:40:43.759789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:43.761625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'cc06bf35-72bb-4c33-b3b5-d4414c98606b'} Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:43.762672 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:43.764135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:43.765557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:43.765557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e7724fc5-7d26-49df-988d-64fba33e07f3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 404 len: 111 microversion: 2.1 time: 0.030816 Aug 30 04:40:43.765557 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 645/1264] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:43 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:43.770564 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-504201d8-c589-4ceb-bfef-29f04d289eb0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '.version_select at 0x7fcda3d68040>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:43.788962 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-504201d8-c589-4ceb-bfef-29f04d289eb0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698183578" status: 202 len: 0 microversion: 2.1 time: 0.022859 Aug 30 04:40:43.789555 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 620/1265] 10.222.0.85 () {58 vars in 1221 bytes} [Tue Aug 30 04:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698183578 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:45.534549 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:45.535091 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:45.541566 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.542092 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.542488 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.543189 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.543645 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.544073 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.559868 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b HTTP/1.1 Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:40:45.561511 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.563329 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'cc06bf35-72bb-4c33-b3b5-d4414c98606b'} Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:45.564296 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.566375 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.567995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:45.567995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-83e8d7cb-10d3-44cf-a792-883ef3d94455 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 404 len: 111 microversion: 2.1 time: 0.032227 Aug 30 04:40:45.567995 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 646/1266] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:45 2022] DELETE /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:45.573067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:45.573767 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: cc06bf35-72bb-4c33-b3b5-d4414c98606b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:45.580533 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.581673 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.582105 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.582817 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.583288 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.583701 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.596813 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b HTTP/1.1 Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:40:45.598469 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.600127 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'cc06bf35-72bb-4c33-b3b5-d4414c98606b'} Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:45.601030 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. Aug 30 04:40:45.602590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:45.604239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance cc06bf35-72bb-4c33-b3b5-d4414c98606b could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:45.604239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-968a9d87-f3f8-4fa0-9a51-1d333fb5dfa2 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b" status: 404 len: 111 microversion: 2.1 time: 0.031341 Aug 30 04:40:45.604239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 621/1267] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:45 2022] GET /compute/v2.1/servers/cc06bf35-72bb-4c33-b3b5-d4414c98606b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:46.743278 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.743857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.750660 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.751212 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.751642 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.752343 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.752789 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.753237 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.767479 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b HTTP/1.1 Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:40:46.769117 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.770767 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': 'bbc79d02-27f4-4b72-a772-c8e01ee2d41b'} Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:46.771813 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.773431 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.775098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:46.775098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1c0b7784-3552-4d6b-ba2f-8fc641b255a6 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 404 len: 111 microversion: 2.1 time: 0.031234 Aug 30 04:40:46.775098 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 647/1268] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:46 2022] DELETE /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:46.779066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.779676 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: bbc79d02-27f4-4b72-a772-c8e01ee2d41b] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.786902 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.787373 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.787802 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.788503 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.788949 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.789399 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.804294 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b HTTP/1.1 Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:40:46.805873 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.807575 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': 'bbc79d02-27f4-4b72-a772-c8e01ee2d41b'} Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:46.808539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. Aug 30 04:40:46.810185 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.811703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance bbc79d02-27f4-4b72-a772-c8e01ee2d41b could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:46.811703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3e1d4f27-23ac-499a-b560-637d086fd9ed tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b" status: 404 len: 111 microversion: 2.1 time: 0.032165 Aug 30 04:40:46.811703 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 622/1269] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:46 2022] GET /compute/v2.1/servers/bbc79d02-27f4-4b72-a772-c8e01ee2d41b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:40:46.815835 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.816328 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.822552 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.823039 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.823471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.824173 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.824622 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.825086 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.839192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 HTTP/1.1 Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:40:46.840808 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.842534 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '19610563-a97a-498d-9f7e-200b0bd70771'} Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:46.843482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.845580 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.847962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:46.847962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fb825302-8cf1-4708-bfad-62b6b07488c8 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 404 len: 111 microversion: 2.1 time: 0.030289 Aug 30 04:40:46.847962 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 648/1270] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:46 2022] DELETE /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:40:46.851300 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.851910 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 19610563-a97a-498d-9f7e-200b0bd70771] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.858239 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.858718 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.859144 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.859828 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.860268 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.860682 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.875434 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 HTTP/1.1 Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:40:46.876955 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.878640 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '19610563-a97a-498d-9f7e-200b0bd70771'} Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:46.879614 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. Aug 30 04:40:46.881197 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:46.882596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance 19610563-a97a-498d-9f7e-200b0bd70771 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:46.882596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d156d0f7-e7cc-4d76-9e53-d93335cb3876 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771" status: 404 len: 111 microversion: 2.1 time: 0.030917 Aug 30 04:40:46.882596 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 623/1271] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:46 2022] GET /compute/v2.1/servers/19610563-a97a-498d-9f7e-200b0bd70771 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:48.022536 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:48.023077 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:48.029635 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:48.030112 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:48.030546 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:48.031235 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:48.031683 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:48.032101 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:48.045512 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f HTTP/1.1 Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:40:48.047038 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.048715 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '6c85f91a-65a8-4467-a74e-e2101053764f'} Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:48.049680 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.051531 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.052875 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:48.052875 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0c0bb4d8-fb2c-484e-b107-cb163f9bc6d0 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 404 len: 111 microversion: 2.1 time: 0.029868 Aug 30 04:40:48.052875 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 649/1272] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:48 2022] DELETE /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:48.057461 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:48.058067 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] [instance: 6c85f91a-65a8-4467-a74e-e2101053764f] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:48.064411 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:48.064881 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:48.065341 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:48.066018 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:48.067126 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:48.067539 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:48.080609 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] HTTP exception thrown: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Request method failure captured: Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f HTTP/1.1 Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZOyhZw4A25HtAOqXzTBUrbRLymc7x7-uNmTrpnAbj1Cl6xydfB7sxbr-C-piw6LX8NRntdcPIWAQQd1eRO6H17H-qpWycGz9QVS0JY8J2cq86IVS_zaQgJVAvCpbWHAR2nZnZOO3mWVOTcg8sQNRoK0RCl-GWbtpUQaCiZk3RRFh7U Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:40:48.082775 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c561fdf35e454833b521f54043c49035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c561fdf35e454833b521f54043c49035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c561fdf35e454833b521f54043c49035"}]}] Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c561fdf35e454833b521f54043c49035 Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496288888 Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 8df68cb66f6d4369bba0eda189b8e64d Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-496288888-project Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.084516 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '6c85f91a-65a8-4467-a74e-e2101053764f'} Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:48.085591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. Aug 30 04:40:48.087169 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:40:48.088560 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] Returning 404 to user: Instance 6c85f91a-65a8-4467-a74e-e2101053764f could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:48.088560 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dbe21aa1-e8ce-4995-b38b-8dc7b93bc6b3 tempest-AttachVolumeNegativeTest-496288888 tempest-AttachVolumeNegativeTest-496288888-project] 10.222.0.85 "GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f" status: 404 len: 111 microversion: 2.1 time: 0.030488 Aug 30 04:40:48.088560 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 624/1273] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:48 2022] GET /compute/v2.1/servers/6c85f91a-65a8-4467-a74e-e2101053764f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:03.724432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:03.725207 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:03.729396 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-27222b39-e243-4c3d-a306-85cf88be42d9 req-b769802c-67de-45e3-8117-5a194b3f0171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225eb902-89f6-40a7-a7ab-6920239fea06", "tag": "2bbc9929-169f-4688-9954-202d82d50d7f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:03.729862 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:03.730137 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:03.735348 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 04:42:03.735727 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Tue Aug 30 04:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Aug 30 04:42:03.736989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:03.737998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=33 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:03.738381 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:03.739034 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:03.739636 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:03.740505 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:03.741621 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:03.742230 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:03.747176 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-27222b39-e243-4c3d-a306-85cf88be42d9 req-b769802c-67de-45e3-8117-5a194b3f0171 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:03.747659 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-27222b39-e243-4c3d-a306-85cf88be42d9 req-b769802c-67de-45e3-8117-5a194b3f0171 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:03.748091 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-27222b39-e243-4c3d-a306-85cf88be42d9 req-b769802c-67de-45e3-8117-5a194b3f0171 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:03.760100 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-27222b39-e243-4c3d-a306-85cf88be42d9 req-b769802c-67de-45e3-8117-5a194b3f0171 service nova] Creating event network-changed:2bbc9929-169f-4688-9954-202d82d50d7f for instance 225eb902-89f6-40a7-a7ab-6920239fea06 on hv-cinder-85426 Aug 30 04:42:03.765220 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-27222b39-e243-4c3d-a306-85cf88be42d9 req-b769802c-67de-45e3-8117-5a194b3f0171 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041026 Aug 30 04:42:03.765821 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 625/1274] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:42:03.773353 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:42:03.851460 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f30763d0-62ec-4488-b34e-d1ed525d7aec tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "DELETE /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 204 len: 0 microversion: 2.1 time: 0.129360 Aug 30 04:42:03.851972 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 650/1275] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:03 2022] DELETE /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:42:03.860915 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:03.861688 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:03.868002 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:03.868485 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:03.868920 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:03.869645 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:03.870097 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:03.870521 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:04.170587 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:04.178186 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fce31e96-0af8-47f1-b51a-37373ad49ff3 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1578 microversion: 2.1 time: 0.321782 Aug 30 04:42:04.179055 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 626/1276] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:03 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1578 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:05.200896 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:05.201626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:05.209200 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.209773 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.210298 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.211135 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.211625 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.212657 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.414760 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:05.422685 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-811c7391-6b67-49e0-b0a9-00c306aef7fe tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1578 microversion: 2.1 time: 0.226568 Aug 30 04:42:05.423252 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 651/1277] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:05 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:42:06.443493 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:06.444141 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:06.450709 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:06.451191 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:06.451626 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:06.452320 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:06.452771 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:06.453223 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:06.583594 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:06.592935 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-09b14343-4ea5-4fd9-9d1b-5739307bc3ca tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1578 microversion: 2.1 time: 0.153315 Aug 30 04:42:06.593546 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 627/1278] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:06 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:07.616268 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:07.617515 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:07.625313 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.626096 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.626535 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.627482 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.628164 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.628794 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.786390 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:07.794606 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4c327884-8002-486c-bc49-7ec0934f1346 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1578 microversion: 2.1 time: 0.182584 Aug 30 04:42:07.795259 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 652/1279] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:07 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:08.721901 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-51441a2c-2ce7-43c6-bcf1-4039d2cc1d97 req-7c650126-031e-4dbb-9a16-9a259a6a4a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225eb902-89f6-40a7-a7ab-6920239fea06", "name": "network-vif-deleted", "tag": "2bbc9929-169f-4688-9954-202d82d50d7f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:08.734134 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-51441a2c-2ce7-43c6-bcf1-4039d2cc1d97 req-7c650126-031e-4dbb-9a16-9a259a6a4a8d service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:08.734605 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-51441a2c-2ce7-43c6-bcf1-4039d2cc1d97 req-7c650126-031e-4dbb-9a16-9a259a6a4a8d service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:08.735026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-51441a2c-2ce7-43c6-bcf1-4039d2cc1d97 req-7c650126-031e-4dbb-9a16-9a259a6a4a8d service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:08.749092 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-51441a2c-2ce7-43c6-bcf1-4039d2cc1d97 req-7c650126-031e-4dbb-9a16-9a259a6a4a8d service nova] Creating event network-vif-deleted:2bbc9929-169f-4688-9954-202d82d50d7f for instance 225eb902-89f6-40a7-a7ab-6920239fea06 on hv-cinder-85426 Aug 30 04:42:08.755715 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-51441a2c-2ce7-43c6-bcf1-4039d2cc1d97 req-7c650126-031e-4dbb-9a16-9a259a6a4a8d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037542 Aug 30 04:42:08.756723 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 628/1280] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:08.815769 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:08.816467 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:08.822942 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:08.823364 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:08.823796 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:08.824487 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:08.825009 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:08.825449 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:08.891432 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:08.900052 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-042eaa3f-222b-4ff4-aa24-844224916be1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 200 len: 1225 microversion: 2.1 time: 0.088166 Aug 30 04:42:08.900765 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 653/1281] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:08 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:09.924053 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:09.924755 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 225eb902-89f6-40a7-a7ab-6920239fea06] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:09.931561 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:09.932045 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:09.932481 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:09.933198 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:09.933686 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:09.934110 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:09.948725 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] HTTP exception thrown: Instance 225eb902-89f6-40a7-a7ab-6920239fea06 could not be found. Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Request method failure captured: Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 HTTP/1.1 Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZNsUYcAT6LZ5wzFy8uN0JTWeZS1Y66GoGkYieppj4ljbqlb3l5I1xoinm9K6i5WFts-iJ3BZaaxDIZlRaKECDsPr9WD3mor_aHm6f5pdxjlC5-wZfzxue9RQoSr6NX-uHbwj9i0NwqvaAeZA0HoIeS_-wf4nKhHDC6ZlyH8xLDc6uM Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:42:09.950475 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_18e4bf7297124da4b43ccaeda048f772"}]}] Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 2625939a0b9a43d59452df9ba9982ecb Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 225eb902-89f6-40a7-a7ab-6920239fea06 could not be found. Aug 30 04:42:09.952833 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '225eb902-89f6-40a7-a7ab-6920239fea06'} Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225eb902-89f6-40a7-a7ab-6920239fea06 could not be found. Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:09.953974 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225eb902-89f6-40a7-a7ab-6920239fea06 could not be found. Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225eb902-89f6-40a7-a7ab-6920239fea06 could not be found. Aug 30 04:42:09.955721 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:09.957242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Returning 404 to user: Instance 225eb902-89f6-40a7-a7ab-6920239fea06 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:09.957242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7e528715-b2e6-49ce-95f7-9722b9df81f7 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06" status: 404 len: 111 microversion: 2.1 time: 0.033434 Aug 30 04:42:09.957242 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 629/1282] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:09 2022] GET /compute/v2.1/servers/225eb902-89f6-40a7-a7ab-6920239fea06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:13.339895 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:13.340433 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:13.343133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-724038e7-fed9-4691-a0c2-a1919f7d8212 req-c8fe9468-9350-416d-95db-f0706fdb16fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8913aeda-b661-4c59-b19b-eb3252bf1047", "tag": "62ae85bd-5cc8-48f9-bbc5-06af77beba2a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:13.350804 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.351607 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.352415 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.353482 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-724038e7-fed9-4691-a0c2-a1919f7d8212 req-c8fe9468-9350-416d-95db-f0706fdb16fb service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.353628 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.354156 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.354676 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.354820 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-724038e7-fed9-4691-a0c2-a1919f7d8212 req-c8fe9468-9350-416d-95db-f0706fdb16fb service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.355204 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-724038e7-fed9-4691-a0c2-a1919f7d8212 req-c8fe9468-9350-416d-95db-f0706fdb16fb service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.370460 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-724038e7-fed9-4691-a0c2-a1919f7d8212 req-c8fe9468-9350-416d-95db-f0706fdb16fb service nova] Creating event network-changed:62ae85bd-5cc8-48f9-bbc5-06af77beba2a for instance 8913aeda-b661-4c59-b19b-eb3252bf1047 on hv-cinder-85426 Aug 30 04:42:13.375776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-724038e7-fed9-4691-a0c2-a1919f7d8212 req-c8fe9468-9350-416d-95db-f0706fdb16fb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037156 Aug 30 04:42:13.376366 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 630/1283] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:42:13.386244 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:42:13.473471 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4a1e46c9-49d4-4aa9-8844-5e276f2124d8 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 204 len: 0 microversion: 2.1 time: 0.136995 Aug 30 04:42:13.474116 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 654/1284] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:13 2022] DELETE /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:42:13.484071 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:13.484776 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:13.491336 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.492058 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.492490 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.493209 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.493845 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.494259 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.644876 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:13.666325 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07e182a2-fbef-4e5c-b4ad-4ef56ef959f1 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1577 microversion: 2.1 time: 0.187224 Aug 30 04:42:13.666919 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 631/1285] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:13 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:14.693766 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:14.695081 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:14.704287 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:14.704820 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:14.705384 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:14.707225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:14.707225 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:14.707445 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:14.844188 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:14.852047 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-443c36b9-57c2-4da5-ae64-049cd9f21d23 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1577 microversion: 2.1 time: 0.166844 Aug 30 04:42:14.852623 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 655/1286] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:14 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:42:15.876322 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:15.877031 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:15.883695 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:15.884166 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:15.884591 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:15.885301 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:15.885746 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:15.886155 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:16.024756 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:16.035044 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d7a523d1-ec46-490d-9bb7-1f62b826bf4c tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1577 microversion: 2.1 time: 0.163548 Aug 30 04:42:16.035687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 632/1287] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:15 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:16.997864 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-42707650-3450-42e0-952f-e49960390e01 req-ddd2ff6a-3fbd-4cee-af15-0b668c8a2980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8913aeda-b661-4c59-b19b-eb3252bf1047", "name": "network-vif-deleted", "tag": "62ae85bd-5cc8-48f9-bbc5-06af77beba2a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:17.007958 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-42707650-3450-42e0-952f-e49960390e01 req-ddd2ff6a-3fbd-4cee-af15-0b668c8a2980 service nova] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:17.008428 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-42707650-3450-42e0-952f-e49960390e01 req-ddd2ff6a-3fbd-4cee-af15-0b668c8a2980 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:17.008860 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-42707650-3450-42e0-952f-e49960390e01 req-ddd2ff6a-3fbd-4cee-af15-0b668c8a2980 service nova] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:17.021067 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-42707650-3450-42e0-952f-e49960390e01 req-ddd2ff6a-3fbd-4cee-af15-0b668c8a2980 service nova] Creating event network-vif-deleted:62ae85bd-5cc8-48f9-bbc5-06af77beba2a for instance 8913aeda-b661-4c59-b19b-eb3252bf1047 on hv-cinder-85426 Aug 30 04:42:17.025873 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-42707650-3450-42e0-952f-e49960390e01 req-ddd2ff6a-3fbd-4cee-af15-0b668c8a2980 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097688 Aug 30 04:42:17.026468 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 656/1288] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:17.057375 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:17.057988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:17.064738 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:17.065531 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:17.065998 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:17.066687 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:17.067133 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:17.067558 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:17.134989 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625939a0b9a43d59452df9ba9982ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e4bf7297124da4b43ccaeda048f772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:17.142843 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-12e06768-493e-42d2-ae3f-2f4004a71ed5 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 200 len: 1225 microversion: 2.1 time: 0.089372 Aug 30 04:42:17.143415 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 633/1289] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:17 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:18.164917 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:18.165668 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 8913aeda-b661-4c59-b19b-eb3252bf1047] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:18.172735 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.173269 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.173710 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.174404 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.174857 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.175320 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.189599 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] HTTP exception thrown: Instance 8913aeda-b661-4c59-b19b-eb3252bf1047 could not be found. Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Request method failure captured: Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 HTTP/1.1 Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZNsUYcAT6LZ5wzFy8uN0JTWeZS1Y66GoGkYieppj4ljbqlb3l5I1xoinm9K6i5WFts-iJ3BZaaxDIZlRaKECDsPr9WD3mor_aHm6f5pdxjlC5-wZfzxue9RQoSr6NX-uHbwj9i0NwqvaAeZA0HoIeS_-wf4nKhHDC6ZlyH8xLDc6uM Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:42:18.191240 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_18e4bf7297124da4b43ccaeda048f772"}]}] Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 2625939a0b9a43d59452df9ba9982ecb Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 8913aeda-b661-4c59-b19b-eb3252bf1047 could not be found. Aug 30 04:42:18.192924 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '8913aeda-b661-4c59-b19b-eb3252bf1047'} Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8913aeda-b661-4c59-b19b-eb3252bf1047 could not be found. Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:18.194095 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8913aeda-b661-4c59-b19b-eb3252bf1047 could not be found. Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8913aeda-b661-4c59-b19b-eb3252bf1047 could not be found. Aug 30 04:42:18.195731 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.197281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Returning 404 to user: Instance 8913aeda-b661-4c59-b19b-eb3252bf1047 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:18.197281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c62f6460-0802-4885-80d0-45377291e366 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047" status: 404 len: 111 microversion: 2.1 time: 0.032422 Aug 30 04:42:18.197281 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 657/1290] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:18 2022] GET /compute/v2.1/servers/8913aeda-b661-4c59-b19b-eb3252bf1047 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:18.644026 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:18.644639 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:18.651066 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.651553 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.651988 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.652896 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.653385 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.653814 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.667863 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] HTTP exception thrown: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Request method failure captured: Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb HTTP/1.1 Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept: application/json Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Connection: close Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Length: 0 Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Content-Type: application/json Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Host: 10.222.0.85 Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjDZNsUYcAT6LZ5wzFy8uN0JTWeZS1Y66GoGkYieppj4ljbqlb3l5I1xoinm9K6i5WFts-iJ3BZaaxDIZlRaKECDsPr9WD3mor_aHm6f5pdxjlC5-wZfzxue9RQoSr6NX-uHbwj9i0NwqvaAeZA0HoIeS_-wf4nKhHDC6ZlyH8xLDc6uM Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Role: member,reader Aug 30 04:42:18.669547 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_18e4bf7297124da4b43ccaeda048f772"}]}] Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Id: 2625939a0b9a43d59452df9ba9982ecb Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: method: > Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: exception: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.672069 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: action_args: {'id': '55c3ec45-de91-4e52-8acd-9cfc102347fb'} Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:18.672884 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.674414 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.675743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Returning 404 to user: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:18.675743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9cbfffe9-dcbe-46cf-a83b-25e39680db55 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "DELETE /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 404 len: 111 microversion: 2.1 time: 0.031381 Aug 30 04:42:18.675743 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 634/1291] 10.222.0.85 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:18 2022] DELETE /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:18.680165 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:18.680777 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] [instance: 55c3ec45-de91-4e52-8acd-9cfc102347fb] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:18.686712 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.687192 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.687626 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.688336 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Acquiring lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.688787 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.689246 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Lock "7b898ea9-960d-4dcf-9a7e-e7ae17af48ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.702681 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] HTTP exception thrown: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Request method failure captured: Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb HTTP/1.1 Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept: application/json Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Connection: close Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Length: 0 Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Content-Type: application/json Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Host: 10.222.0.85 Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjDZNsUYcAT6LZ5wzFy8uN0JTWeZS1Y66GoGkYieppj4ljbqlb3l5I1xoinm9K6i5WFts-iJ3BZaaxDIZlRaKECDsPr9WD3mor_aHm6f5pdxjlC5-wZfzxue9RQoSr6NX-uHbwj9i0NwqvaAeZA0HoIeS_-wf4nKhHDC6ZlyH8xLDc6uM Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Role: member,reader Aug 30 04:42:18.704201 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/18e4bf7297124da4b43ccaeda048f772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_18e4bf7297124da4b43ccaeda048f772"}]}] Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 18e4bf7297124da4b43ccaeda048f772 Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestVolumeBootPattern-362673499 Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Id: 2625939a0b9a43d59452df9ba9982ecb Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestVolumeBootPattern-362673499-project Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: method: > Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: exception: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.706019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: action_args: {'id': '55c3ec45-de91-4e52-8acd-9cfc102347fb'} Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:18.707019 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. Aug 30 04:42:18.708619 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Aug 30 04:42:18.710113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Returning 404 to user: Instance 55c3ec45-de91-4e52-8acd-9cfc102347fb could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:18.710113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-695c4a1b-0bf3-4cc3-9e28-177049d6ace9 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb" status: 404 len: 111 microversion: 2.1 time: 0.029264 Aug 30 04:42:18.710113 dv-cinder-854265-2-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 658/1292] 10.222.0.85 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:18 2022] GET /compute/v2.1/servers/55c3ec45-de91-4e52-8acd-9cfc102347fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:42:20.005063 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ec3a3b18-3566-4a0b-8c37-296fd22aa523 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] Calling method '.version_select at 0x7fcda8147ee0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:20.032590 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ec3a3b18-3566-4a0b-8c37-296fd22aa523 tempest-TestVolumeBootPattern-362673499 tempest-TestVolumeBootPattern-362673499-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-754690315" status: 202 len: 0 microversion: 2.1 time: 0.032789 Aug 30 04:42:20.033498 dv-cinder-854265-2-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 635/1293] 10.222.0.85 () {58 vars in 1260 bytes} [Tue Aug 30 04:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-754690315 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)